Jul 22 01:44:03 devstack cinder-volume[76253]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 01:44:03 devstack cinder-volume[76253]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 01:44:03 devstack cinder-volume[76253]: we strongly recommend against using it for new projects. Jul 22 01:44:03 devstack cinder-volume[76253]: If you are already using Eventlet, we recommend migrating to a different Jul 22 01:44:03 devstack cinder-volume[76253]: framework. For more detail see Jul 22 01:44:03 devstack cinder-volume[76253]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 01:44:03 devstack cinder-volume[76253]: import eventlet # noqa Jul 22 01:44:06 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:44:06 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:44:06 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:44:07 devstack cinder-volume[76253]: INFO dbcounter [None req-b73841ef-e870-46b6-b519-67383238156a None None] Registered counter for database cinder Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG oslo_db.sqlalchemy.engines [None req-b73841ef-e870-46b6-b519-67383238156a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG dbcounter [-] [76253] Writer thread running {{(pid=76253) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:44:07 devstack cinder-volume[76253]: INFO cinder.rpc [None req-b73841ef-e870-46b6-b519-67383238156a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 01:44:07 devstack cinder-volume[76253]: INFO cinder.rpc [None req-b73841ef-e870-46b6-b519-67383238156a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG oslo_db.sqlalchemy.engines [None req-b73841ef-e870-46b6-b519-67383238156a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:44:07 devstack cinder-volume[76253]: INFO cinder.volume.manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Determined volume DB was empty at startup. Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG cinder.volume.manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76253) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 01:44:07 devstack cinder-volume[76253]: INFO cinder.volume.manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 01:44:07 devstack cinder-volume[76253]: WARNING stevedore.named [None req-b73841ef-e870-46b6-b519-67383238156a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 01:44:07 devstack cinder-volume[76253]: WARNING castellan.key_manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:44:07 devstack cinder-volume[76253]: WARNING cinder.keymgr.conf_key_mgr [None req-b73841ef-e870-46b6-b519-67383238156a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG cinder.volume.drivers.lvm [None req-b73841ef-e870-46b6-b519-67383238156a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76253) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 22 01:44:07 devstack cinder-volume[76253]: DEBUG oslo_concurrency.processutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76253) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_concurrency.processutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] CMD "cinder-rtstool verify" returned: 0 in 0.426s {{(pid=76253) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_db.sqlalchemy.engines [None req-b73841ef-e870-46b6-b519-67383238156a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:44:08 devstack cinder-volume[76253]: INFO cinder.rpc [None req-b73841ef-e870-46b6-b519-67383238156a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 22 01:44:08 devstack cinder-volume[76253]: INFO cinder.rpc [None req-b73841ef-e870-46b6-b519-67383238156a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 22 01:44:08 devstack cinder-volume[76253]: WARNING stevedore.named [None req-b73841ef-e870-46b6-b519-67383238156a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 01:44:08 devstack cinder-volume[76253]: WARNING castellan.key_manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:44:08 devstack cinder-volume[76253]: INFO cinder.volume.manager [None req-b73841ef-e870-46b6-b519-67383238156a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_db.sqlalchemy.engines [None req-b73841ef-e870-46b6-b519-67383238156a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:44:08 devstack cinder-volume[76253]: INFO oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Starting 1 workers Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Started child 76400 {{(pid=76253) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Full set of CONF: {{(pid=76253) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] ******************************************************************************** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Configuration options gathered from: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 01:44:08 devstack cinder-volume[76400]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] ================================================================================ {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] allow_availability_zone_fallback = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] allow_compression_on_image_upload = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] allowed_direct_url_schemes = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] api_rate_limit = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] auth_strategy = keystone {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] az_cache_duration = 3600 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_availability_zone = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_host = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_stats_polling_interval = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backup_api_class = cinder.backup.api.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backup_name_template = backup-%s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backup_use_same_host = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backup_use_temp_snapshot = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] chap_password = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] chap_username = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_internal_tenant_project_id = 1a1934229ea54f209efdd0c4eb34b85e {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_internal_tenant_user_id = ee3bfb7b186d48358675844727501e2a {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cloned_volume_same_az = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cluster = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] compression_format = gzip {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] compute_api_class = cinder.compute.nova.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] config_dir = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] config_source = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] control_exchange = openstack {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] debug = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] default_availability_zone = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] default_group_type = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] default_volume_type = lvmdriver-1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] disk_geometry = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_client_cert = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_client_cert_key = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_data_namespace = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_ssl_cert_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_ssl_cert_verify = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] driver_use_ssl = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] enable_force_upload = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] enable_new_services = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] enable_unsupported_driver = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] enabled_backends = ['lvmdriver-1'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] enforce_multipath_for_image_xfer = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] filter_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_api_insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_api_ssl_compression = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_ca_certificates_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_catalog_info = image:glance:publicURL {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_num_retries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance_request_timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] goodness_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] graceful_shutdown_timeout = 5 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] group_api_class = cinder.group.api.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] host = devstack {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_compress_on_upload = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_conversion_address_space_limit = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_conversion_cpu_limit = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_conversion_disable = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_upload_use_cinder_backend = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_upload_use_internal_tenant = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_volume_cache_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_volume_cache_max_count = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] image_volume_cache_max_size_gb = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] init_host_max_objects_retrieval = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] instance_format = [instance: %(uuid)s] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iscsi_target_flags = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iscsi_write_cache = on {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iser_helper = tgtadm {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: INFO cinder.volume.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iser_ip_address = 192.168.122.21 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iser_port = 3260 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_color = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_config_append = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_dir = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_options = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_rotate_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_rotate_interval_type = days {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] log_rotation_type = none {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] max_age = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] max_logfile_count = 30 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] max_logfile_size_mb = 200 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] max_over_subscription_ratio = 20.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] message_reap_interval = 86400 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] message_ttl = 2592000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] migration_create_volume_timeout_secs = 300 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] monkey_patch = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] monkey_patch_modules = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] my_ip = 192.168.122.21 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] no_snapshot_gb_quota = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] num_iser_scan_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] num_shell_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] num_volume_device_scan_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] nvmeof_conn_info_version = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] nvmet_ns_id = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] nvmet_port_id = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_max_limit = 1000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_ext_list = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_listen = 0.0.0.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_listen_port = 8776 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_use_ssl = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] osapi_volume_workers = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] per_volume_size_limit = -1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] periodic_fuzzy_delay = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] periodic_interval = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] project_id_regex = [0-9a-f\-]+ {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] public_endpoint = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] publish_errors = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_backup_gigabytes = 1000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_backups = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_gigabytes = 1000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_groups = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_snapshots = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] quota_volumes = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] rate_limit_burst = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] rate_limit_except_level = CRITICAL {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] rate_limit_interval = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] reinit_driver_count = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] replication_device = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] report_discard_supported = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] report_interval = 120 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] reservation_clean_interval = 86400 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] reservation_expire = 86400 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] reserved_image_namespaces = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] reserved_percentage = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] rpc_response_timeout = 120 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] run_external_periodic_tasks = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] scst_target_driver = iscsi {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] scst_target_iqn_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_down_time = 720 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] shell_completion = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] snapshot_name_template = snapshot-%s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] snapshot_same_host = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] split_loggers = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] state_path = /opt/stack/data/cinder {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] storage_availability_zone = nova {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] storage_protocol = iSCSI {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] syslog_log_facility = LOG_USER {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_helper = lioadm {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_ip_address = 192.168.122.21 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_port = 3260 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_protocol = iscsi {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] target_secondary_ip_addresses = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] trace_flags = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] transfer_api_class = cinder.transfer.api.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] transport_url = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] until_refresh = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_chap_auth = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_default_quota_class = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_journal = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_json = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_multipath_for_image_xfer = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_stderr = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] use_syslog = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] verify_glance_signatures = enabled {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_api_class = cinder.volume.api.API {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_backend_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_clear = zero {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_clear_ionice = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_clear_size = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_copy_bps_limit = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_dd_blocksize = 1M {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_name_template = volume-%s {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_service_inithost_offload = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volume_usage_audit_period = month {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] zoning_mode = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_concurrency.disable_process_locking = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.auth_section = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.auth_type = password {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.auth_version = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.cache = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.delay_auth_decision = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.http_connect_timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.include_service_catalog = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.interface = public {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_password = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcache_username = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.region_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.service_token_roles_required = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.service_type = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.token_cache_time = 300 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:08 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.backend = dogpile.cache.null {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.backend_argument = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.backend_expiration_time = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.config_prefix = cache.oslo {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.debug_cache_backend = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.enable_retry_client = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.enable_socket_keepalive = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.expiration_time = 600 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.hashclient_retry_attempts = 2 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_dead_retry = 300 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_pool_maxsize = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_sasl_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.password = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.proxies = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.redis_db = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.redis_sentinel_service_name = mymaster {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.redis_server = localhost:6379 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.retry_attempts = 2 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.retry_delay = 0.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.socket_keepalive_count = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.socket_keepalive_idle = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.socket_keepalive_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.socket_timeout = 1.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.tls_allowed_ciphers = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.tls_cafile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.tls_certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.tls_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.tls_keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cache.username = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] coordination.backend_url = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.asyncio_connection = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.asyncio_slave_connection = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.backend = sqlalchemy {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.connection = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.connection_debug = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.connection_parameters = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.connection_recycle_time = 3600 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.connection_trace = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.db_inc_retry_interval = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.db_max_retries = 20 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.db_max_retry_interval = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.db_retry_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.max_overflow = 50 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack sudo[76460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 22 01:44:08 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.max_pool_size = 5 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.max_retries = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.mysql_wsrep_sync_wait = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.pool_timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.retry_interval = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.slave_connection = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.sqlite_synchronous = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.synchronous_reader = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] database.use_db_reconnect = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.connection_string = messaging:// {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.es_doc_type = notification {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.es_scroll_size = 10000 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.es_scroll_time = 2m {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.filter_error_trace = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.hmac_keys = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.sentinel_service_name = mymaster {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.socket_timeout = 0.1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.trace_requests = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler.trace_sqlalchemy = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler_jaeger.process_tags = {} {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler_jaeger.service_name_prefix = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] profiler_otlp.service_name_prefix = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.enforce_new_defaults = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.policy_default_rule = default {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.policy_file = policy.yaml {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_policy.remote_timeout = 60.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.group = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.helper_command = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] privsep_osbrick.user = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.group = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.helper_command = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] cinder_sys_admin.user = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.auth_section = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.auth_type = password {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.cafile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.collect_timing = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.send_service_user_token = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.split_loggers = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] service_user.timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.auth_section = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.auth_type = password {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.collect_timing = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.region_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.split_loggers = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] glance.timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.backend_availability_zone = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.chap_password = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.chap_username = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.disk_geometry = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_client_cert = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_client_cert_key = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_data_namespace = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.driver_use_ssl = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.enable_unsupported_driver = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.extra_capabilities = {} {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.filter_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.goodness_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iscsi_target_flags = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iscsi_write_cache = on {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iser_helper = tgtadm {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iser_port = 3260 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.lvm_mirrors = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.lvm_share_target = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.lvm_type = auto {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.num_shell_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.nvmet_port_id = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.replication_device = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.report_discard_supported = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.reserved_percentage = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.scst_target_driver = iscsi {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.scst_target_iqn_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.storage_protocol = iSCSI {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_helper = tgtadm {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_port = 3260 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_protocol = iscsi {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.trace_flags = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.unique_fqdn_network = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.use_chap_auth = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_backend_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_clear = zero {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_clear_ionice = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_clear_size = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volume_group = cinder-volumes {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_reports.file_event_handler = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_reports.log_dir = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.backend_availability_zone = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.backend_host = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.chap_password = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.chap_username = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.chiscsi_conf = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.disk_geometry = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_client_cert = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_data_namespace = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.driver_use_ssl = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.extra_capabilities = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.filter_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.goodness_function = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iser_helper = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iser_ip_address = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iser_port = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.iser_target_prefix = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.lvm_conf_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.lvm_mirrors = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.lvm_share_target = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.lvm_type = auto {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.num_shell_tries = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.nvmet_port_id = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.replication_device = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.report_discard_supported = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.reserved_percentage = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.scst_target_driver = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.storage_protocol = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_helper = lioadm {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_ip_address = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_port = 3260 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_protocol = iscsi {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.trace_flags = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.use_chap_auth = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_clear = zero {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_clear_size = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] lvmdriver-1.volumes_dir = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.ssl_version = {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_notifications.driver = [] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_notifications.retry = -1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] oslo_messaging_notifications.transport_url = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] key_manager.fixed_key = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.barbican_api_version = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:08 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.barbican_endpoint = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.barbican_endpoint_type = public {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.barbican_region_name = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.cafile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.collect_timing = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.number_of_retries = 60 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.retry_delay = 1 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.send_service_user_token = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.split_loggers = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.verify_ssl = True {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican.verify_ssl_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.auth_section = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.auth_type = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.cafile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.certfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.collect_timing = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.insecure = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.keyfile = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.split_loggers = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] barbican_service_user.timeout = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.approle_role_id = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.approle_secret_id = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.auth_method = approle {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.auth_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.kv_mountpoint = secret {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.kv_path = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.kv_version = 2 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.namespace = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.root_token_id = **** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.ssl_ca_crt_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.timeout = 60.0 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.token_file = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.token_role = None {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.use_ssl = False {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:44:09 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] ******************************************************************************** {{(pid=76253) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 01:44:09 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.360s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:09 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:09 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:09 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.252s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 01:44:09 devstack cinder-volume[76400]: INFO cinder.brick.local_dev.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:09 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:09 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:09 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG cinder.brick.local_dev.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76400) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 22 01:44:09 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:09 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:09 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:10 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:10 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:10 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:10 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:10 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 22 01:44:10 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:10 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.275s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:10 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:10 devstack sudo[77071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:10 devstack sudo[77071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:11 devstack sudo[77071]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:11 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:11 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:11 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:11 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:11 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:11 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:11 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:11 devstack sudo[77183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:11 devstack sudo[77183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:12 devstack sudo[77183]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack sudo[77196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:12 devstack sudo[77196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:12 devstack sudo[77196]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: INFO cinder.volume.drivers.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:12 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:12 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack sudo[77203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:12 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:12 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:12 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:12 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:12 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:13 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:13 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:13 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:13 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:13 devstack sudo[77219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:13 devstack sudo[77219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:13 devstack sudo[77219]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:13 devstack cinder-volume[76400]: INFO cinder.volume.driver [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Driver hasn't implemented _init_vendor_properties() Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG cinder.volume.driver [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76400) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_db.sqlalchemy.engines [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76400) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writer thread running {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG cinder.db.api [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Building query based on filter {{(pid=76400) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG cinder.image.image_utils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76400) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 01:44:13 devstack cinder-volume[76400]: INFO cinder.keymgr.migration [None req-af9ca086-28d3-4cb9-a7e4-604b79731601 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:13 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:13 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:13 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:13 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:14 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:14 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:14 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:14 devstack sudo[77231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:14 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:14 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:14 devstack sudo[77234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:14 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:14 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG cinder.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Notifying Schedulers of capabilities ... {{(pid=76400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:44:14 devstack cinder-volume[76400]: INFO cinder.volume.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Driver initialization completed successfully. Jul 22 01:44:14 devstack cinder-volume[76400]: INFO cinder.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Initiating service 2 cleanup Jul 22 01:44:14 devstack cinder-volume[76400]: INFO cinder.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Service 2 cleanup completed. Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG cinder.service [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Creating RPC server for service cinder-volume {{(pid=76400) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG cinder.service [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76400) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 01:44:14 devstack cinder-volume[76400]: INFO cinder.volume.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:44:14 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:14 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:44:14 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:15 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:15 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:15 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:15 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:15 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:44:15 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:15 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:15 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:44:15 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:44:15 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:44:16 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Jul 22 01:44:16 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:44:16 devstack cinder-volume[76400]: INFO cinder.volume.manager [None req-40f793a4-b417-4ae6-a451-eaf26ef78c64 None None] Driver post RPC initialization completed successfully. Jul 22 01:44:17 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager._thread_info {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:44:17 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread count: 6 {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:44:17 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread info: [<_MainThread(MainThread, started 123289730179200)>, , , , , ] {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:44:18 devstack cinder-volume[76253]: DEBUG dbcounter [-] [76253] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76253) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:44:24 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:44:26 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:45:17 devstack sudo[79259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:45:17 devstack sudo[79259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:45:17 devstack sudo[79259]: pam_unix(sudo:session): session closed for user root Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:45:17 devstack sudo[79273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:45:17 devstack sudo[79273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:45:17 devstack sudo[79273]: pam_unix(sudo:session): session closed for user root Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:45:17 devstack sudo[79283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:45:17 devstack sudo[79283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:45:17 devstack sudo[79283]: pam_unix(sudo:session): session closed for user root Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:45:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:45:17 devstack sudo[79286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:45:17 devstack sudo[79286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:45:18 devstack sudo[79286]: pam_unix(sudo:session): session closed for user root Jul 22 01:45:18 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:45:18 devstack cinder-volume[76400]: DEBUG cinder.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Notifying Schedulers of capabilities ... {{(pid=76400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:45:18 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager._thread_info {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:45:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread count: 6 {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:45:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread info: [<_MainThread(MainThread, started 123289730179200)>, , , , , ] {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:46:17 devstack sudo[82565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:46:17 devstack sudo[82565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:46:17 devstack sudo[82565]: pam_unix(sudo:session): session closed for user root Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:46:17 devstack sudo[82569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:46:17 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:46:17 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:46:17 devstack sudo[82572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:46:17 devstack sudo[82572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:46:17 devstack sudo[82572]: pam_unix(sudo:session): session closed for user root Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:46:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:46:17 devstack sudo[82582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:46:17 devstack sudo[82582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:46:18 devstack sudo[82582]: pam_unix(sudo:session): session closed for user root Jul 22 01:46:18 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:46:18 devstack cinder-volume[76400]: DEBUG cinder.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Notifying Schedulers of capabilities ... {{(pid=76400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:46:26 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:47:17 devstack sudo[84567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:47:17 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:47:17 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:47:17 devstack sudo[84581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:47:17 devstack sudo[84581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:47:17 devstack sudo[84581]: pam_unix(sudo:session): session closed for user root Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:47:17 devstack sudo[84584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:47:17 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:47:17 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:47:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:47:17 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:47:17 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:47:18 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Jul 22 01:47:18 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:47:18 devstack cinder-volume[76400]: DEBUG cinder.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Notifying Schedulers of capabilities ... {{(pid=76400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:47:18 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager._thread_info {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:47:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread count: 6 {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:47:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread info: [<_MainThread(MainThread, started 123289730179200)>, , , , , ] {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG cinder.volume.drivers.lvm [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Updating volume stats {{(pid=76400) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:17 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 22 01:48:17 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:17 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:17 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:48:17 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:17 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:17 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 22 01:48:17 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:17 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:17 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:17 devstack sudo[85903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 22 01:48:17 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:18 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:18 devstack cinder-volume[76400]: DEBUG oslo_concurrency.processutils [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76400) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:18 devstack cinder-volume[76400]: DEBUG cinder.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Notifying Schedulers of capabilities ... {{(pid=76400) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:48:18 devstack cinder-volume[76400]: DEBUG oslo_service.periodic_task [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] Running periodic task VolumeManager._thread_info {{(pid=76400) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:48:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread count: 6 {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:48:18 devstack cinder-volume[76400]: DEBUG cinder.volume.manager [None req-2c672ccb-d466-4bca-a6f3-378b1847d210 None None] thread info: [<_MainThread(MainThread, started 123289730179200)>, , , , , ] {{(pid=76400) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:48:26 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writing DB stats cinder:SELECT=1 {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:48:26 devstack cinder-volume[76400]: DEBUG dbcounter [-] [76400] Writing DB stats cinder:UPDATE=1 {{(pid=76400) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:48:41 devstack cinder-volume[76253]: INFO oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Caught SIGTERM, stopping children Jul 22 01:48:41 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Acquiring lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:41 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Acquired lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:41 devstack cinder-volume[76253]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Releasing lock "singleton_lock" {{(pid=76253) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:41 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Stop services. {{(pid=76253) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 01:48:41 devstack cinder-volume[76253]: DEBUG oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Killing children. {{(pid=76253) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 01:48:41 devstack cinder-volume[76253]: INFO oslo_service.backend._eventlet.service [None req-b73841ef-e870-46b6-b519-67383238156a None None] Waiting on 1 children to exit Jul 22 01:48:46 devstack cinder-volume[76400]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 22 01:48:47 devstack cinder-volume[86526]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 01:48:47 devstack cinder-volume[86526]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 01:48:47 devstack cinder-volume[86526]: we strongly recommend against using it for new projects. Jul 22 01:48:47 devstack cinder-volume[86526]: If you are already using Eventlet, we recommend migrating to a different Jul 22 01:48:47 devstack cinder-volume[86526]: framework. For more detail see Jul 22 01:48:47 devstack cinder-volume[86526]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 01:48:47 devstack cinder-volume[86526]: import eventlet # noqa Jul 22 01:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:49 devstack cinder-volume[86526]: INFO dbcounter [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Registered counter for database cinder Jul 22 01:48:49 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:48:49 devstack cinder-volume[76400]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Acquiring lock "singleton_lock" {{(pid=76400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:49 devstack cinder-volume[76400]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Acquired lock "singleton_lock" {{(pid=76400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:49 devstack cinder-volume[76400]: DEBUG oslo_concurrency.lockutils [None req-b73841ef-e870-46b6-b519-67383238156a None None] Releasing lock "singleton_lock" {{(pid=76400) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:49 devstack cinder-volume[76400]: WARNING amqp [None req-b73841ef-e870-46b6-b519-67383238156a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 01:48:49 devstack cinder-volume[76400]: WARNING amqp [None req-b73841ef-e870-46b6-b519-67383238156a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writer thread running {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:48:50 devstack cinder-volume[86526]: INFO cinder.rpc [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 01:48:50 devstack cinder-volume[86526]: INFO cinder.rpc [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:48:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Determined volume DB was empty at startup. Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86526) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 01:48:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 22 01:48:50 devstack cinder-volume[86526]: WARNING stevedore.named [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 01:48:50 devstack cinder-volume[86526]: WARNING castellan.key_manager [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:48:50 devstack cinder-volume[86526]: WARNING cinder.keymgr.conf_key_mgr [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:48:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:48:50 devstack cinder-volume[86526]: INFO oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Starting 1 workers Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Started child 86745 {{(pid=86526) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Full set of CONF: {{(pid=86526) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] ******************************************************************************** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Configuration options gathered from: {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] ================================================================================ {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] allow_availability_zone_fallback = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] allow_compression_on_image_upload = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] allowed_direct_url_schemes = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] api_rate_limit = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] auth_strategy = keystone {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_availability_zone = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_host = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_stats_polling_interval = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backup_api_class = cinder.backup.api.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backup_name_template = backup-%s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backup_use_same_host = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backup_use_temp_snapshot = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] chap_password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] chap_username = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86745]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_internal_tenant_project_id = 1a1934229ea54f209efdd0c4eb34b85e {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_internal_tenant_user_id = ee3bfb7b186d48358675844727501e2a {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cluster = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] compression_format = gzip {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] compute_api_class = cinder.compute.nova.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] config_dir = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] config_source = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] control_exchange = openstack {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] debug = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] default_availability_zone = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] default_group_type = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] default_volume_type = QuobyteHD {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] disk_geometry = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_client_cert = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_client_cert_key = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_data_namespace = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_ssl_cert_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_ssl_cert_verify = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] driver_use_ssl = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] enable_new_services = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] enable_unsupported_driver = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] enabled_backends = ['QuobyteHD'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] enforce_multipath_for_image_xfer = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] filter_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_api_insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_api_ssl_compression = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_ca_certificates_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_catalog_info = image:glance:publicURL {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_num_retries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance_request_timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] goodness_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] graceful_shutdown_timeout = 5 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] group_api_class = cinder.group.api.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] host = devstack {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_compress_on_upload = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_conversion_address_space_limit = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_conversion_cpu_limit = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_conversion_disable = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_upload_use_cinder_backend = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_upload_use_internal_tenant = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_volume_cache_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_volume_cache_max_count = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] image_volume_cache_max_size_gb = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] init_host_max_objects_retrieval = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] instance_format = [instance: %(uuid)s] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iscsi_target_flags = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iscsi_write_cache = on {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iser_helper = tgtadm {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iser_ip_address = 192.168.122.21 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iser_port = 3260 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_color = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_config_append = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_dir = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_options = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_rotate_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_rotate_interval_type = days {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] log_rotation_type = none {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] max_age = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] max_logfile_count = 30 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] max_logfile_size_mb = 200 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] max_over_subscription_ratio = 20.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] message_reap_interval = 86400 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] message_ttl = 2592000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] migration_create_volume_timeout_secs = 300 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] monkey_patch = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] monkey_patch_modules = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] my_ip = 192.168.122.21 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] no_snapshot_gb_quota = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] num_iser_scan_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] num_shell_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] num_volume_device_scan_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] nvmeof_conn_info_version = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] nvmet_ns_id = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] nvmet_port_id = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_max_limit = 1000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_ext_list = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_listen_port = 8776 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_use_ssl = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] osapi_volume_workers = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] per_volume_size_limit = -1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] periodic_fuzzy_delay = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] periodic_interval = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] public_endpoint = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] publish_errors = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_backup_gigabytes = 1000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_backups = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_gigabytes = 1000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_groups = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_snapshots = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] quota_volumes = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] rate_limit_burst = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] rate_limit_except_level = CRITICAL {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] rate_limit_interval = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] reinit_driver_count = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] replication_device = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] report_discard_supported = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] report_interval = 120 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] reservation_clean_interval = 86400 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] reservation_expire = 86400 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] reserved_image_namespaces = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] reserved_percentage = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] rpc_response_timeout = 120 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] run_external_periodic_tasks = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] scst_target_driver = iscsi {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] scst_target_iqn_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_down_time = 720 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] shell_completion = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] snapshot_name_template = snapshot-%s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] split_loggers = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] state_path = /opt/stack/data/cinder {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] storage_availability_zone = nova {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] storage_protocol = iSCSI {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] syslog_log_facility = LOG_USER {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_helper = lioadm {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_ip_address = 192.168.122.21 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_port = 3260 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_protocol = iscsi {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] target_secondary_ip_addresses = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] trace_flags = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] transport_url = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] until_refresh = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_chap_auth = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_default_quota_class = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_journal = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_json = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_multipath_for_image_xfer = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_stderr = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] use_syslog = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] verify_glance_signatures = enabled {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_api_class = cinder.volume.api.API {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_backend_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_clear = zero {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_clear_ionice = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_clear_size = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_copy_bps_limit = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_dd_blocksize = 1M {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_name_template = volume-%s {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_service_inithost_offload = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volume_usage_audit_period = month {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] zoning_mode = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_concurrency.disable_process_locking = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.auth_section = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.auth_type = password {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.auth_version = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.cache = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.include_service_catalog = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.interface = public {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_password = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcache_username = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.region_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.service_type = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.backend = dogpile.cache.null {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.backend_argument = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.backend_expiration_time = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.config_prefix = cache.oslo {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.debug_cache_backend = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.enable_retry_client = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.enable_socket_keepalive = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.expiration_time = 600 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.hashclient_retry_attempts = 2 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_dead_retry = 300 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_pool_maxsize = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_sasl_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.proxies = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.redis_db = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.redis_server = localhost:6379 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.retry_attempts = 2 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.retry_delay = 0.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.socket_keepalive_count = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.socket_keepalive_idle = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.socket_keepalive_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.socket_timeout = 1.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.tls_allowed_ciphers = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.tls_cafile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.tls_certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.tls_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.tls_keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cache.username = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] coordination.backend_url = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.asyncio_connection = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.asyncio_slave_connection = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.backend = sqlalchemy {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.connection = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86745]: INFO cinder.volume.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Starting volume driver QuobyteDriver (1.2) Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.connection_debug = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.connection_parameters = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.connection_recycle_time = 3600 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.remotefs [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86745) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.connection_trace = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.db_inc_retry_interval = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.db_max_retries = 20 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.db_max_retry_interval = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.db_retry_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.max_overflow = 50 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.max_pool_size = 5 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.max_retries = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.mysql_wsrep_sync_wait = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.pool_timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.retry_interval = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.slave_connection = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.sqlite_synchronous = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.synchronous_reader = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] database.use_db_reconnect = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.connection_string = messaging:// {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.es_doc_type = notification {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.es_scroll_size = 10000 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.es_scroll_time = 2m {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.filter_error_trace = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.hmac_keys = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.sentinel_service_name = mymaster {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.socket_timeout = 0.1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.trace_requests = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler.trace_sqlalchemy = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler_jaeger.process_tags = {} {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler_jaeger.service_name_prefix = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] profiler_otlp.service_name_prefix = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.enforce_new_defaults = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.policy_default_rule = default {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.policy_file = policy.yaml {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.group = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.helper_command = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] privsep_osbrick.user = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.group = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.helper_command = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] cinder_sys_admin.user = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.auth_section = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.auth_type = password {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.cafile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.collect_timing = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.send_service_user_token = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.split_loggers = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] service_user.timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.auth_section = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.auth_type = password {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.collect_timing = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.region_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.split_loggers = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] glance.timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.backend_availability_zone = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.chap_password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.chap_username = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.disk_geometry = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_client_cert = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_client_cert_key = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_data_namespace = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.driver_use_ssl = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.extra_capabilities = {} {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.filter_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.goodness_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iscsi_target_flags = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iscsi_write_cache = on {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iser_helper = tgtadm {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iser_port = 3260 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_host = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_login = admin {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_mount_options = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_private_key = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_share_path = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.num_shell_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.quobyte_volume_url = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.replication_device = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.report_discard_supported = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.reserved_percentage = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_helper = tgtadm {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_port = 3260 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_protocol = iscsi {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.trace_flags = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.unique_fqdn_network = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.use_chap_auth = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_backend_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_clear = zero {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_clear_ionice = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_clear_size = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_reports.file_event_handler = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_reports.log_dir = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.backend_availability_zone = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.backend_host = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.chap_password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.chap_username = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.chiscsi_conf = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.disk_geometry = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_client_cert = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_data_namespace = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.driver_use_ssl = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.extra_capabilities = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.filter_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.goodness_function = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iser_helper = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iser_ip_address = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iser_port = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.iser_target_prefix = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_host = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_login = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_mount_options = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_password = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_private_key = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_share_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_ssh_port = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.num_shell_tries = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.nvmet_port_id = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.replication_device = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.report_discard_supported = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.reserved_percentage = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.scst_target_driver = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.storage_protocol = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_helper = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_ip_address = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_port = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_prefix = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_protocol = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.trace_flags = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.use_chap_auth = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_clear = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_clear_size = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] QuobyteHD.volumes_dir = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86745) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 01:48:50 devstack cinder-volume[86745]: WARNING cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 01:48:50 devstack cinder-volume[86745]: WARNING cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_notifications.driver = [] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_notifications.retry = -1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Running cmd (subprocess): mount.quobyte {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] key_manager.fixed_key = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.barbican_api_version = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.barbican_endpoint = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.barbican_endpoint_type = public {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.barbican_region_name = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.cafile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.collect_timing = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.number_of_retries = 60 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.retry_delay = 1 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.send_service_user_token = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.split_loggers = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.verify_ssl = True {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican.verify_ssl_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.auth_section = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.auth_type = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.cafile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.certfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.collect_timing = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.insecure = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.keyfile = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.split_loggers = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] barbican_service_user.timeout = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.approle_role_id = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.approle_secret_id = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.auth_method = approle {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.auth_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.kv_mountpoint = secret {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.kv_path = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.kv_version = 2 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.namespace = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.root_token_id = **** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.ssl_ca_crt_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.timeout = 60.0 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.token_file = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.token_role = None {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.use_ssl = False {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:48:50 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] ******************************************************************************** {{(pid=86526) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 01:48:50 devstack quobyte-client[86750]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 01:48:50 devstack quobyte-client[86750]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=86745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:48:50 devstack cinder-volume[86745]: INFO cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e ... Jul 22 01:48:50 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 -c /etc/quobyte/client-cinder.cfg {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:50 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 -c /etc/quobyte/client-cinder.cfg Jul 22 01:48:50 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:51 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.381s {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e succeeded Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=86745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.392s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:51 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:48:51 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:51 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.266s {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.volume.driver [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Driver hasn't implemented _init_vendor_properties() Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.volume.driver [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6981163024902, 'free_capacity_gb': 1775.6981163024902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86745) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_db.sqlalchemy.engines [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86745) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG dbcounter [-] [86745] Writer thread running {{(pid=86745) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.db.api [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Building query based on filter {{(pid=86745) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.image.image_utils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86745) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.keymgr.migration [None req-49ad5fcd-acfd-4684-a83a-51cd5864e77d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=86745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=86745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:51 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:48:51 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:51 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.240s {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Notifying Schedulers of capabilities ... {{(pid=86745) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.volume.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Driver initialization completed successfully. Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Initiating service 3 cleanup Jul 22 01:48:51 devstack cinder-volume[86745]: INFO cinder.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Service 3 cleanup completed. Jul 22 01:48:51 devstack cinder-volume[86745]: DEBUG cinder.service [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Creating RPC server for service cinder-volume {{(pid=86745) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG cinder.service [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86745) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 01:48:52 devstack cinder-volume[86745]: INFO cinder.volume.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=86745) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG cinder.volume.drivers.quobyte [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=86745) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86745) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:48:52 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:48:52 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:48:52 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Jul 22 01:48:52 devstack cinder-volume[86745]: DEBUG oslo_concurrency.processutils [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.270s {{(pid=86745) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:48:52 devstack cinder-volume[86745]: INFO cinder.volume.manager [None req-7f03cc76-7e0f-415d-b04e-0aed24123f6b None None] Driver post RPC initialization completed successfully. Jul 22 01:48:55 devstack cinder-volume[86526]: INFO oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Caught SIGTERM, stopping children Jul 22 01:48:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Acquiring lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Acquired lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Releasing lock "singleton_lock" {{(pid=86526) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:55 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Stop services. {{(pid=86526) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 22 01:48:55 devstack cinder-volume[86526]: DEBUG oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Killing children. {{(pid=86526) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 22 01:48:55 devstack cinder-volume[86526]: INFO oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Waiting on 1 children to exit Jul 22 01:48:56 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Acquiring lock "singleton_lock" {{(pid=86745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:56 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Acquired lock "singleton_lock" {{(pid=86745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:56 devstack cinder-volume[86745]: DEBUG oslo_concurrency.lockutils [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Releasing lock "singleton_lock" {{(pid=86745) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:56 devstack cinder-volume[86745]: WARNING amqp [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 01:48:56 devstack cinder-volume[86745]: WARNING amqp [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 22 01:48:56 devstack cinder-volume[86526]: INFO oslo_service.backend._eventlet.service [None req-93d6b3df-d443-4125-97ff-dc53c418ff7f None None] Child 86745 exited with status 0 Jul 22 01:48:56 devstack cinder-volume[87064]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 22 01:48:56 devstack cinder-volume[87064]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 01:48:56 devstack cinder-volume[87064]: we strongly recommend against using it for new projects. Jul 22 01:48:56 devstack cinder-volume[87064]: If you are already using Eventlet, we recommend migrating to a different Jul 22 01:48:56 devstack cinder-volume[87064]: framework. For more detail see Jul 22 01:48:56 devstack cinder-volume[87064]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 01:48:56 devstack cinder-volume[87064]: import eventlet # noqa Jul 22 01:48:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 22 01:48:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 22 01:48:58 devstack cinder-volume[87064]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 22 01:48:59 devstack cinder-volume[87064]: INFO dbcounter [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Registered counter for database cinder Jul 22 01:48:59 devstack cinder-volume[87064]: DEBUG oslo_db.sqlalchemy.engines [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:48:59 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writer thread running {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:49:00 devstack cinder-volume[87064]: INFO cinder.rpc [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 22 01:49:00 devstack cinder-volume[87064]: INFO cinder.rpc [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_db.sqlalchemy.engines [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:49:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Determined volume DB was empty at startup. Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG cinder.volume.manager [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87064) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 22 01:49:00 devstack cinder-volume[87064]: WARNING stevedore.named [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 22 01:49:00 devstack cinder-volume[87064]: WARNING castellan.key_manager [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:49:00 devstack cinder-volume[87064]: WARNING cinder.keymgr.conf_key_mgr [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 22 01:49:00 devstack cinder-volume[87064]: INFO cinder.volume.manager [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_db.sqlalchemy.engines [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:49:00 devstack cinder-volume[87064]: INFO oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Starting 1 workers Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Started child 87153 {{(pid=87064) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Full set of CONF: {{(pid=87064) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] ******************************************************************************** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] Configuration options gathered from: {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] ================================================================================ {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] allow_availability_zone_fallback = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] allow_compression_on_image_upload = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87153]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] allowed_direct_url_schemes = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] api_rate_limit = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] auth_strategy = keystone {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_availability_zone = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_host = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_stats_polling_interval = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backup_api_class = cinder.backup.api.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backup_name_template = backup-%s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backup_use_same_host = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backup_use_temp_snapshot = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] chap_password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] chap_username = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_internal_tenant_project_id = 1a1934229ea54f209efdd0c4eb34b85e {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_internal_tenant_user_id = ee3bfb7b186d48358675844727501e2a {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cluster = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] compression_format = gzip {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] compute_api_class = cinder.compute.nova.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] config_dir = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] config_source = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] control_exchange = openstack {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] debug = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] default_availability_zone = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] default_group_type = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] default_volume_type = QuobyteHD {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] disk_geometry = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_client_cert = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_client_cert_key = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_data_namespace = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_ssl_cert_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_ssl_cert_verify = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] driver_use_ssl = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] enable_new_services = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] enable_unsupported_driver = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] enabled_backends = ['QuobyteHD'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] enforce_multipath_for_image_xfer = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] filter_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_api_insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_api_ssl_compression = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_ca_certificates_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_catalog_info = image:glance:publicURL {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_num_retries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance_request_timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] goodness_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] graceful_shutdown_timeout = 5 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] group_api_class = cinder.group.api.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] host = devstack {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_compress_on_upload = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_conversion_address_space_limit = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_conversion_cpu_limit = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_conversion_disable = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_upload_use_cinder_backend = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_upload_use_internal_tenant = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_volume_cache_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_volume_cache_max_count = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] image_volume_cache_max_size_gb = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] init_host_max_objects_retrieval = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] instance_format = [instance: %(uuid)s] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iscsi_target_flags = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iscsi_write_cache = on {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iser_helper = tgtadm {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iser_ip_address = 192.168.122.21 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iser_port = 3260 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_color = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_config_append = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_dir = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_options = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_rotate_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_rotate_interval_type = days {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] log_rotation_type = none {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] max_age = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] max_logfile_count = 30 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] max_logfile_size_mb = 200 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] max_over_subscription_ratio = 20.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] message_reap_interval = 86400 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] message_ttl = 2592000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] migration_create_volume_timeout_secs = 300 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] monkey_patch = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] monkey_patch_modules = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] my_ip = 192.168.122.21 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] no_snapshot_gb_quota = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] num_iser_scan_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] num_shell_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] num_volume_device_scan_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] nvmeof_conn_info_version = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] nvmet_ns_id = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] nvmet_port_id = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_max_limit = 1000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Starting volume driver QuobyteDriver (1.2) Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_ext_list = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87153) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_listen_port = 8776 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_use_ssl = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] osapi_volume_workers = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] per_volume_size_limit = -1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] periodic_fuzzy_delay = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] periodic_interval = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] public_endpoint = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] publish_errors = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_backup_gigabytes = 1000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_backups = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_gigabytes = 1000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_groups = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_snapshots = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] quota_volumes = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] rate_limit_burst = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] rate_limit_except_level = CRITICAL {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] rate_limit_interval = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] reinit_driver_count = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] replication_device = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] report_discard_supported = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] report_interval = 120 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] reservation_clean_interval = 86400 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] reservation_expire = 86400 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] reserved_image_namespaces = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] reserved_percentage = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] rpc_response_timeout = 120 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] run_external_periodic_tasks = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] scst_target_driver = iscsi {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] scst_target_iqn_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_down_time = 720 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] shell_completion = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] snapshot_name_template = snapshot-%s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] split_loggers = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] state_path = /opt/stack/data/cinder {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] storage_availability_zone = nova {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] storage_protocol = iSCSI {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] syslog_log_facility = LOG_USER {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_helper = lioadm {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_ip_address = 192.168.122.21 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_port = 3260 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_protocol = iscsi {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] target_secondary_ip_addresses = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] trace_flags = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] transport_url = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] until_refresh = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_chap_auth = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_default_quota_class = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_journal = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_json = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_multipath_for_image_xfer = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_stderr = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] use_syslog = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] verify_glance_signatures = enabled {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_api_class = cinder.volume.api.API {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_backend_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_clear = zero {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_clear_ionice = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_clear_size = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_copy_bps_limit = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_dd_blocksize = 1M {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_name_template = volume-%s {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_service_inithost_offload = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volume_usage_audit_period = month {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] zoning_mode = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_concurrency.disable_process_locking = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.auth_section = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.auth_type = password {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.auth_version = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.cache = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.include_service_catalog = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.interface = public {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_password = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcache_username = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.region_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.service_type = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.backend = dogpile.cache.null {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.backend_argument = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.backend_expiration_time = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.config_prefix = cache.oslo {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.debug_cache_backend = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.enable_retry_client = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.enable_socket_keepalive = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.expiration_time = 600 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.hashclient_retry_attempts = 2 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_dead_retry = 300 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_pool_maxsize = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_sasl_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.proxies = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.redis_db = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.redis_server = localhost:6379 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.retry_attempts = 2 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.retry_delay = 0.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.socket_keepalive_count = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.socket_keepalive_idle = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.socket_keepalive_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.socket_timeout = 1.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.tls_allowed_ciphers = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.tls_cafile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.tls_certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.tls_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.tls_keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cache.username = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] coordination.backend_url = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.asyncio_connection = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.asyncio_slave_connection = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.backend = sqlalchemy {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.connection = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.connection_debug = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.connection_parameters = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.connection_recycle_time = 3600 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.connection_trace = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.db_inc_retry_interval = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.db_max_retries = 20 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.db_max_retry_interval = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.db_retry_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.max_overflow = 50 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.max_pool_size = 5 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.max_retries = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.mysql_wsrep_sync_wait = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.pool_timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.retry_interval = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.slave_connection = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.sqlite_synchronous = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.synchronous_reader = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] database.use_db_reconnect = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.connection_string = messaging:// {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.es_doc_type = notification {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87153) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.es_scroll_size = 10000 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 22 01:49:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.es_scroll_time = 2m {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.filter_error_trace = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.hmac_keys = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.sentinel_service_name = mymaster {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Running cmd (subprocess): mount.quobyte {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.socket_timeout = 0.1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.trace_requests = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler.trace_sqlalchemy = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler_jaeger.process_tags = {} {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler_jaeger.service_name_prefix = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] profiler_otlp.service_name_prefix = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.enforce_new_defaults = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.policy_default_rule = default {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.policy_file = policy.yaml {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.group = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.helper_command = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] privsep_osbrick.user = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.group = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.helper_command = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] cinder_sys_admin.user = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.auth_section = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.auth_type = password {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.cafile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.collect_timing = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.send_service_user_token = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.split_loggers = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] service_user.timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.auth_section = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.auth_type = password {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.collect_timing = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.region_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.split_loggers = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] glance.timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.backend_availability_zone = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.chap_password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.chap_username = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.disk_geometry = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_client_cert = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_client_cert_key = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_data_namespace = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.driver_use_ssl = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.extra_capabilities = {} {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.filter_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.goodness_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iscsi_target_flags = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iscsi_write_cache = on {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iser_helper = tgtadm {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iser_port = 3260 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_host = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_login = admin {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_mount_options = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_private_key = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_share_path = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.num_shell_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.quobyte_volume_url = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.replication_device = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.report_discard_supported = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.reserved_percentage = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_helper = tgtadm {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_port = 3260 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_protocol = iscsi {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.trace_flags = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.unique_fqdn_network = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.use_chap_auth = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_backend_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_clear = zero {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_clear_ionice = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_clear_size = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_reports.file_event_handler = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_reports.log_dir = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.backend_availability_zone = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.backend_host = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.chap_password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.chap_username = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.chiscsi_conf = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.disk_geometry = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_client_cert = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_data_namespace = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack quobyte-client[87155]: Reading configuration file: /etc/quobyte/client.cfg Jul 22 01:49:00 devstack quobyte-client[87155]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.driver_use_ssl = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.extra_capabilities = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.filter_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.goodness_function = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iser_helper = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iser_ip_address = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iser_port = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.iser_target_prefix = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_host = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_login = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_mount_options = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_password = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_private_key = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_share_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_ssh_port = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.num_shell_tries = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.nvmet_port_id = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.replication_device = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.report_discard_supported = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.reserved_percentage = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.scst_target_driver = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.storage_protocol = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_helper = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_ip_address = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_port = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_prefix = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_protocol = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.trace_flags = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.use_chap_auth = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_clear = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_clear_size = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] QuobyteHD.volumes_dir = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_notifications.driver = [] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_notifications.retry = -1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] key_manager.fixed_key = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:49:00 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.barbican_api_version = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.barbican_endpoint = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.barbican_endpoint_type = public {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.barbican_region_name = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.cafile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.collect_timing = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.number_of_retries = 60 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.retry_delay = 1 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.send_service_user_token = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.split_loggers = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.verify_ssl = True {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican.verify_ssl_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.auth_section = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.auth_type = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.cafile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.certfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.collect_timing = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.insecure = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.keyfile = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.split_loggers = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] barbican_service_user.timeout = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.approle_role_id = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.approle_secret_id = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.auth_method = approle {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.auth_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.kv_mountpoint = secret {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.kv_path = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.kv_version = 2 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.namespace = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.root_token_id = **** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.ssl_ca_crt_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.timeout = 60.0 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.token_file = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.token_role = None {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.use_ssl = False {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 22 01:49:00 devstack cinder-volume[87064]: DEBUG oslo_service.backend._eventlet.service [None req-6df400b6-15d1-43f5-8a3e-a7b8f71c6047 None None] ******************************************************************************** {{(pid=87064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 22 01:49:00 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.238s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:49:00 devstack cinder-volume[87153]: INFO cinder.volume.driver [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Driver hasn't implemented _init_vendor_properties() Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.driver [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6981163024902, 'free_capacity_gb': 1775.6981163024902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87153) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_db.sqlalchemy.engines [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writer thread running {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.db.api [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Building query based on filter {{(pid=87153) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87153) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:49:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:49:00 devstack cinder-volume[87153]: INFO cinder.keymgr.migration [None req-a54e020c-a268-4580-9271-18494abde9f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 22 01:49:00 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:49:00 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:49:01 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.236s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:49:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Driver initialization completed successfully. Jul 22 01:49:01 devstack cinder-volume[87153]: INFO cinder.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Initiating service 3 cleanup Jul 22 01:49:01 devstack cinder-volume[87153]: INFO cinder.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Service 3 cleanup completed. Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG cinder.service [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Creating RPC server for service cinder-volume {{(pid=87153) start /opt/stack/cinder/cinder/service.py:231}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG cinder.service [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87153) start /opt/stack/cinder/cinder/service.py:237}} Jul 22 01:49:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:49:01 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:49:01 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:49:01 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Jul 22 01:49:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.237s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:49:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d0667d75-c554-4c31-9b6e-9c8fb17b726a None None] Driver post RPC initialization completed successfully. Jul 22 01:49:10 devstack cinder-volume[87064]: DEBUG dbcounter [-] [87064] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:49:11 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:49:11 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:49:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:49:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 6 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:49:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:50:52 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:50:52 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:50:52 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.316s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 6 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:50:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:51:11 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Flow 'volume_create_manager' (a4f7bc98-0d87-4d45-a92e-ce95074a67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac19fb-1cb7-401b-90d6-7198f3a4e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ac19fb-1cb7-401b-90d6-7198f3a4e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957598253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb065a90-27de-45c5-8d38-e10c5fbc2a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07f6855ab8e46fe954ee00d90e42b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:36Z,use_quota=True,user_id='099f9a408ef44c10bd435e2a2f1d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec4d304-0efc-43ce-a808-06f17ec5cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec4d304-0efc-43ce-a808-06f17ec5cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885b592f-d6e3-4e42-8943-3b9bf35d780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885b592f-d6e3-4e42-8943-3b9bf35d780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb065a90-27de-45c5-8d38-e10c5fbc2a19', 'volume_name': 'volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40674856-2d44-4495-b884-f908af1b6ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40674856-2d44-4495-b884-f908af1b6ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3081350c-a553-4788-ae8f-9456acecef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Volume eb065a90-27de-45c5-8d38-e10c5fbc2a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19', 'volume_size': 1} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-957598253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb065a90-27de-45c5-8d38-e10c5fbc2a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07f6855ab8e46fe954ee00d90e42b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:36Z,use_quota=True,user_id='099f9a408ef44c10bd435e2a2f1d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Creating volume eb065a90-27de-45c5-8d38-e10c5fbc2a19 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:51:36 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:36 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 1073741824 Jul 22 01:51:36 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:36 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 1073741824" returned: 0 in 0.622s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:37 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 Jul 22 01:51:37 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:37 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19" returned: 0 in 0.318s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3081350c-a553-4788-ae8f-9456acecef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e746e-6362-4c0e-a696-d2438a4d0798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Volume volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 (eb065a90-27de-45c5-8d38-e10c5fbc2a19): created successfully Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e746e-6362-4c0e-a696-d2438a4d0798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Flow 'volume_create_manager' (a4f7bc98-0d87-4d45-a92e-ce95074a67ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:51:37 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e65476f9-0929-4d60-b8fb-5562bbf65702 tempest-TaggedAttachmentsTest-1148047977 None] Created volume successfully. Jul 22 01:51:47 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:51:47 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Flow 'volume_create_manager' (14901b2d-a075-4d7d-b34c-f1f001e7d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d400971-e92b-4301-bf4c-524d54ba7b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d400971-e92b-4301-bf4c-524d54ba7b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-306319505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c89019-1187-4c77-9ac9-bb8a89034f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac6a957cc334e19b43f5d77c1c164b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:52Z,use_quota=True,user_id='9681374fc01140ee84164f4a7489c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8007554-e2e6-421a-b444-a12fb5b76fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8007554-e2e6-421a-b444-a12fb5b76fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096fe39-c892-44d2-806e-f8c343f22712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a096fe39-c892-44d2-806e-f8c343f22712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c89019-1187-4c77-9ac9-bb8a89034f77', 'volume_name': 'volume-a5c89019-1187-4c77-9ac9-bb8a89034f77', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae60b2c-5bb7-407d-933c-eb0341e673e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae60b2c-5bb7-407d-933c-eb0341e673e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400124ad-8db4-4c72-8405-0c76f44fa461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:52 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Volume a5c89019-1187-4c77-9ac9-bb8a89034f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c89019-1187-4c77-9ac9-bb8a89034f77', 'volume_size': 1} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-306319505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c89019-1187-4c77-9ac9-bb8a89034f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac6a957cc334e19b43f5d77c1c164b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:52Z,use_quota=True,user_id='9681374fc01140ee84164f4a7489c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Creating volume a5c89019-1187-4c77-9ac9-bb8a89034f77 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:51:52 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:52 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 1073741824 Jul 22 01:51:52 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:52 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:51:52 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:53 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 1073741824" returned: 0 in 1.042s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:53 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.776s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:53 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 Jul 22 01:51:53 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:53 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77" returned: 0 in 0.446s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400124ad-8db4-4c72-8405-0c76f44fa461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c89019-1187-4c77-9ac9-bb8a89034f77', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fba004e-dd02-48e2-a76f-c4fd1dc2e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Volume volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 (a5c89019-1187-4c77-9ac9-bb8a89034f77): created successfully Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fba004e-dd02-48e2-a76f-c4fd1dc2e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Flow 'volume_create_manager' (14901b2d-a075-4d7d-b34c-f1f001e7d08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:51:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dc12add5-f5e0-470a-bbf1-731abff468c6 tempest-DeleteServersTestJSON-1375126822 None] Created volume successfully. Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Flow 'volume_create_manager' (607f381d-96bc-45ce-84c8-2b5b01e5a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0adc62c-0ee4-4333-ae0b-0c4c2e076314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0adc62c-0ee4-4333-ae0b-0c4c2e076314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1941665465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f6e8ad-ea7f-4496-96d1-06e4201f51a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574756793e154e3aa9e28619c60ab44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:57Z,use_quota=True,user_id='62f7563612dd49829787a22782db70f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8cc654-a66f-41f5-8389-1df4d2e88998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8cc654-a66f-41f5-8389-1df4d2e88998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d172327-ecf1-4af1-a1c1-e0844edc1c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d172327-ecf1-4af1-a1c1-e0844edc1c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f6e8ad-ea7f-4496-96d1-06e4201f51a9', 'volume_name': 'volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3c8cb-faa2-4bf0-8492-bf7b7aaded35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3c8cb-faa2-4bf0-8492-bf7b7aaded35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1540771c-69a1-4899-a6bf-c486cf9789aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Volume 88f6e8ad-ea7f-4496-96d1-06e4201f51a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9', 'volume_size': 1} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1941665465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f6e8ad-ea7f-4496-96d1-06e4201f51a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574756793e154e3aa9e28619c60ab44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:51:57Z,use_quota=True,user_id='62f7563612dd49829787a22782db70f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Creating volume 88f6e8ad-ea7f-4496-96d1-06e4201f51a9 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.128s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:51:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:51:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:58 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 1073741824 Jul 22 01:51:58 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:58 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 1073741824" returned: 0 in 0.992s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:51:59 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 Jul 22 01:51:59 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:51:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" returned: 0 in 0.866s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:51:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:51:59 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Jul 22 01:51:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:51:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1540771c-69a1-4899-a6bf-c486cf9789aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:51:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddcf9ce-15c4-489d-9f0a-98eb4ed1d891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:51:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Volume volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 (88f6e8ad-ea7f-4496-96d1-06e4201f51a9): created successfully Jul 22 01:52:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddcf9ce-15c4-489d-9f0a-98eb4ed1d891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:52:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Flow 'volume_create_manager' (607f381d-96bc-45ce-84c8-2b5b01e5a067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:52:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-19f22cc5-44c6-44ee-8f76-c854572d44e5 tempest-VolumesAdminNegativeTest-975803203 None] Created volume successfully. Jul 22 01:52:02 devstack cinder-volume[87153]: WARNING py.warnings [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 22 01:52:02 devstack cinder-volume[87153]: .first() Jul 22 01:52:02 devstack cinder-volume[87153]: Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Acquiring lock "cinder-88f6e8ad-ea7f-4496-96d1-06e4201f51a9-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "cinder-88f6e8ad-ea7f-4496-96d1-06e4201f51a9-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-a5c89019-1187-4c77-9ac9-bb8a89034f77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '523cef61-e15e-4b0b-868a-2de449d4c812', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Acquiring lock "cinder-quobyte-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:52:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "cinder-quobyte-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" acquired by "delete_volume" :: waited 0.055s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:52:02 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgjee6kb3/privsep.sock'] Jul 22 01:52:02 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgjee6kb3/privsep.sock Jul 22 01:52:02 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-934fff25-8f02-43b0-b1ee-d68038499086 req-ef4eb365-47f3-4b64-bece-599e96da13f3 tempest-DeleteServersTestJSON-1375126822 None] attachment_update completed successfully. Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: Jul 22 01:52:04 devstack cinder-volume[87153]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 22 01:52:05 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:05 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Spawned new privsep daemon via rootwrap Jul 22 01:52:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Accepted privsep connection to /tmp/tmpgjee6kb3/privsep.sock {{(pid=87153) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 22 01:52:05 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 22 01:52:05 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 22 01:52:05 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 22 01:52:05 devstack cinder-volume[87153]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89077 Jul 22 01:52:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb1a15-d71f-42e6-8eab-637e8cdf4207]: (2,) {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:52:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad6660d-bf7f-4758-98ff-017ae7a4d80d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:52:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:05 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 Jul 22 01:52:05 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:06 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" returned: 0 in 0.823s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:06 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9 Jul 22 01:52:06 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:06 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "cinder-quobyte-88f6e8ad-ea7f-4496-96d1-06e4201f51a9" released by "delete_volume" :: held 4.138s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:52:06 devstack cinder-volume[87153]: WARNING cinder.quota [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:52:06 devstack cinder-volume[87153]: WARNING cinder.quota [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:52:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Created reservations ['370061c2-85ca-4b8e-b549-66cf123df47b', 'bfaac4f1-f1bb-4a17-8b74-9a53200f3c7f', '8997d5b6-2e7d-4aa3-b78d-3823b592070b', '50397065-b598-4414-a426-d7b14fac7485'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:07 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:52:07 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:07 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:52:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Deleted volume successfully. Jul 22 01:52:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3943bb47-ac32-4670-b8db-1dc483dbf3a5 tempest-VolumesAdminNegativeTest-975803203 None] Lock "cinder-88f6e8ad-ea7f-4496-96d1-06e4201f51a9-delete_volume" released by "delete_volume" :: held 5.368s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:52:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-77ef46a2-ff6d-4d83-8d4d-926998b836ed req-3b251b14-55e3-46c1-9034-9a517081d8c8 tempest-DeleteServersTestJSON-1375126822 None] Terminate volume connection completed successfully. Jul 22 01:52:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-77ef46a2-ff6d-4d83-8d4d-926998b836ed req-3b251b14-55e3-46c1-9034-9a517081d8c8 tempest-DeleteServersTestJSON-1375126822 None] Deleting attachment 523cef61-e15e-4b0b-868a-2de449d4c812. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "cinder-a5c89019-1187-4c77-9ac9-bb8a89034f77-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "cinder-a5c89019-1187-4c77-9ac9-bb8a89034f77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "cinder-quobyte-a5c89019-1187-4c77-9ac9-bb8a89034f77" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "cinder-quobyte-a5c89019-1187-4c77-9ac9-bb8a89034f77" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c41d4-feb0-45fb-b923-3144143c4fc9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:52:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:13 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 Jul 22 01:52:13 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:14 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77" returned: 0 in 0.544s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:14 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77 Jul 22 01:52:14 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:14 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a5c89019-1187-4c77-9ac9-bb8a89034f77" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "cinder-quobyte-a5c89019-1187-4c77-9ac9-bb8a89034f77" released by "delete_volume" :: held 0.979s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Created reservations ['bc9e8021-20df-49e9-8724-921767e53ff5', '62dd2130-0c2d-447f-91ca-fe1dac25c4f6', '786781fe-d2e8-4d8e-a412-4b9d4366e98c', 'dda9127f-e25c-45c3-8b07-614ed6b5732c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:52:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:14 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:52:14 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:15 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.385s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:15 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:52:15 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Deleted volume successfully. Jul 22 01:52:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffd5c037-8f98-47d5-ae83-a928094280a7 tempest-DeleteServersTestJSON-1375126822 None] Lock "cinder-a5c89019-1187-4c77-9ac9-bb8a89034f77-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:52:24 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=25,cinder:SELECT=22,cinder:INSERT=3 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:52:25 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=4 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:52:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-54835026-7742-44c9-b828-24e7ce058cde req-76c0b0de-d126-40e2-992d-79a10f441a4e tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:52:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-54835026-7742-44c9-b828-24e7ce058cde req-76c0b0de-d126-40e2-992d-79a10f441a4e tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:52:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-54835026-7742-44c9-b828-24e7ce058cde req-76c0b0de-d126-40e2-992d-79a10f441a4e tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:52:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-54835026-7742-44c9-b828-24e7ce058cde req-76c0b0de-d126-40e2-992d-79a10f441a4e tempest-TaggedAttachmentsTest-1148047977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4709ccd3-601e-4aa6-a8ca-22f0626af972', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:52:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-54835026-7742-44c9-b828-24e7ce058cde req-76c0b0de-d126-40e2-992d-79a10f441a4e tempest-TaggedAttachmentsTest-1148047977 None] attachment_update completed successfully. Jul 22 01:52:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3e9d0c6b-a4ff-4897-be41-a0f670226a42 req-7be59659-aba6-494c-a50c-359d1f3c49cf tempest-TaggedAttachmentsTest-1148047977 None] Terminate volume connection completed successfully. Jul 22 01:52:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3e9d0c6b-a4ff-4897-be41-a0f670226a42 req-7be59659-aba6-494c-a50c-359d1f3c49cf tempest-TaggedAttachmentsTest-1148047977 None] Deleting attachment 4709ccd3-601e-4aa6-a8ca-22f0626af972. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:52:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:52:52 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:52:52 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:52:53 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Jul 22 01:52:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.712s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:52:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:52:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:52:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:52:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:52:57 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:52:57 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Flow 'volume_create_manager' (31d53570-e0de-4b46-a445-09599ecbe476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8c58f1-ccba-499a-8f63-1c875096995b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8c58f1-ccba-499a-8f63-1c875096995b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1141920767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e2a110-7e8b-424f-a0e1-bd2429d11e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22eb9050f0104956ae8e8f3e59ec0280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:06Z,use_quota=True,user_id='cd47777ea16a4be0ab9612381565d6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a381977-fea9-48e7-a650-a57fee5b283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a381977-fea9-48e7-a650-a57fee5b283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a538e351-79a3-4f42-80a9-185c5ab8caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a538e351-79a3-4f42-80a9-185c5ab8caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e2a110-7e8b-424f-a0e1-bd2429d11e4d', 'volume_name': 'volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ee1b6-15b3-4bdd-96ad-17548a77ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ee1b6-15b3-4bdd-96ad-17548a77ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53b09d-9219-4c40-b5f8-2ba8742f99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Volume b3e2a110-7e8b-424f-a0e1-bd2429d11e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d', 'volume_size': 1} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1141920767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e2a110-7e8b-424f-a0e1-bd2429d11e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22eb9050f0104956ae8e8f3e59ec0280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:06Z,use_quota=True,user_id='cd47777ea16a4be0ab9612381565d6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Creating volume b3e2a110-7e8b-424f-a0e1-bd2429d11e4d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:53:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:53:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:06 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d 1073741824 Jul 22 01:53:06 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:07 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d 1073741824" returned: 0 in 1.059s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:07 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d Jul 22 01:53:07 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:08 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" returned: 0 in 0.465s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53b09d-9219-4c40-b5f8-2ba8742f99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecfa2a9-1dac-402c-ab99-9b49269a377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:08 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Volume volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d (b3e2a110-7e8b-424f-a0e1-bd2429d11e4d): created successfully Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecfa2a9-1dac-402c-ab99-9b49269a377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Flow 'volume_create_manager' (31d53570-e0de-4b46-a445-09599ecbe476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6c04dff4-71d4-4010-9343-7665c59105f4 tempest-ServerRescueNegativeTestJSON-1611289090 None] Created volume successfully. Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "cinder-eb065a90-27de-45c5-8d38-e10c5fbc2a19-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "cinder-eb065a90-27de-45c5-8d38-e10c5fbc2a19-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "cinder-quobyte-eb065a90-27de-45c5-8d38-e10c5fbc2a19" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "cinder-quobyte-eb065a90-27de-45c5-8d38-e10c5fbc2a19" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93be60-1702-45af-9b6a-5d49726f1e06]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:53:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:10 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 Jul 22 01:53:10 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:11 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19" returned: 0 in 0.872s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:11 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19 Jul 22 01:53:11 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:12 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eb065a90-27de-45c5-8d38-e10c5fbc2a19" returned: 0 in 0.876s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "cinder-quobyte-eb065a90-27de-45c5-8d38-e10c5fbc2a19" released by "delete_volume" :: held 1.868s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Created reservations ['09ae66b5-b04e-4117-9be0-59b176437f6b', '35af5935-fd6d-43c7-b0dd-2451609cb91d', '1a8c0eb4-e8b5-4d71-a1fc-779390e11ca7', '74004d5e-b12a-4d75-b602-3c1c9340caa1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:13 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:53:13 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:13 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.572s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:53:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Deleted volume successfully. Jul 22 01:53:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-00387d0f-f614-4a58-a5a2-642bb42354d8 tempest-TaggedAttachmentsTest-1148047977 None] Lock "cinder-eb065a90-27de-45c5-8d38-e10c5fbc2a19-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Flow 'volume_create_manager' (ab87f67a-3be1-48db-b46b-e8b4cd298ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef837d7a-ebc3-416b-ade2-2d73fd442add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef837d7a-ebc3-416b-ade2-2d73fd442add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1589257607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbdcb49-a386-4f97-8c3f-7d2af8e905f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32b5c014bc400a8ee84be37b9e38e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:17Z,use_quota=True,user_id='dd759daa9c644b3f9b19a4eeef9b6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab50794-fd61-4031-b6ff-315bc10277d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab50794-fd61-4031-b6ff-315bc10277d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7030db-7517-40c8-a488-f817629f35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7030db-7517-40c8-a488-f817629f35c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbdcb49-a386-4f97-8c3f-7d2af8e905f0', 'volume_name': 'volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da2a332-0ed4-4c9c-8e37-1411582f79d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da2a332-0ed4-4c9c-8e37-1411582f79d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0d653-6456-4193-981e-a946648d8d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume edbdcb49-a386-4f97-8c3f-7d2af8e905f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0', 'volume_size': 1} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1589257607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbdcb49-a386-4f97-8c3f-7d2af8e905f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32b5c014bc400a8ee84be37b9e38e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:17Z,use_quota=True,user_id='dd759daa9c644b3f9b19a4eeef9b6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Creating volume edbdcb49-a386-4f97-8c3f-7d2af8e905f0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:53:17 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:53:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:17 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 1073741824 Jul 22 01:53:17 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:18 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 1073741824" returned: 0 in 0.873s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:18 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 Jul 22 01:53:18 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:18 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" returned: 0 in 0.503s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0d653-6456-4193-981e-a946648d8d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcccb42-a991-4067-ac8e-f230ec302fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 (edbdcb49-a386-4f97-8c3f-7d2af8e905f0): created successfully Jul 22 01:53:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcccb42-a991-4067-ac8e-f230ec302fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Flow 'volume_create_manager' (ab87f67a-3be1-48db-b46b-e8b4cd298ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3e4ad11e-5135-4179-8046-b9b1a3b691b5 tempest-VolumeQuotasAdminTestJSON-322560292 None] Created volume successfully. Jul 22 01:53:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "cinder-edbdcb49-a386-4f97-8c3f-7d2af8e905f0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "cinder-edbdcb49-a386-4f97-8c3f-7d2af8e905f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "cinder-quobyte-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "cinder-quobyte-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" acquired by "delete_volume" :: waited 0.075s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:20 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c26aaa-461c-47f7-9f09-adb7ff9f6384]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:53:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:20 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 Jul 22 01:53:20 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:20 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" returned: 0 in 0.695s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:20 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0 Jul 22 01:53:20 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:21 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" returned: 0 in 0.372s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "cinder-quobyte-edbdcb49-a386-4f97-8c3f-7d2af8e905f0" released by "delete_volume" :: held 1.184s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Created reservations ['200f680c-86ed-403b-879b-37e1d8ef6c31', '12ea5662-4613-4cf3-afad-23147495058a', 'e1852291-77cd-46cd-a497-42d577979f41', '860bfaf1-d286-43bd-9168-cc4f2a68a0d7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:21 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:53:21 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:21 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.546s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:53:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Deleted volume successfully. Jul 22 01:53:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5fa1a236-5eaa-41a8-b491-3ce41cc6c077 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "cinder-edbdcb49-a386-4f97-8c3f-7d2af8e905f0-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Flow 'volume_create_manager' (7b7b48fb-d1ef-470a-9730-558776dc79a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d6a691-88b2-40de-875e-2809df07dac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d6a691-88b2-40de-875e-2809df07dac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1041713332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df57e04-2f97-4653-8cf1-5839ef9763b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32b5c014bc400a8ee84be37b9e38e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:23Z,use_quota=True,user_id='dd759daa9c644b3f9b19a4eeef9b6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8d9c3e-5f4c-45d8-bb67-24db3ed7aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8d9c3e-5f4c-45d8-bb67-24db3ed7aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2237f3-d5ab-4096-af3c-c1725da88b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2237f3-d5ab-4096-af3c-c1725da88b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df57e04-2f97-4653-8cf1-5839ef9763b5', 'volume_name': 'volume-2df57e04-2f97-4653-8cf1-5839ef9763b5', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3880af76-fcfe-408b-a65f-c68374168100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3880af76-fcfe-408b-a65f-c68374168100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c8979a-2911-4b28-8be5-1beda4328381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume 2df57e04-2f97-4653-8cf1-5839ef9763b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df57e04-2f97-4653-8cf1-5839ef9763b5', 'volume_size': 1} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1041713332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df57e04-2f97-4653-8cf1-5839ef9763b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc32b5c014bc400a8ee84be37b9e38e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:23Z,use_quota=True,user_id='dd759daa9c644b3f9b19a4eeef9b6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Creating volume 2df57e04-2f97-4653-8cf1-5839ef9763b5 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:53:23 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:53:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:23 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 1073741824 Jul 22 01:53:23 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:24 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 1073741824" returned: 0 in 1.303s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:24 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 Jul 22 01:53:24 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:25 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5" returned: 0 in 0.507s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c8979a-2911-4b28-8be5-1beda4328381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df57e04-2f97-4653-8cf1-5839ef9763b5', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05485c6d-cc90-42eb-b07b-6386d8032414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Volume volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 (2df57e04-2f97-4653-8cf1-5839ef9763b5): created successfully Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05485c6d-cc90-42eb-b07b-6386d8032414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Flow 'volume_create_manager' (7b7b48fb-d1ef-470a-9730-558776dc79a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ac94388c-1927-4dc3-9d8d-e8a52f63c6e1 tempest-VolumeQuotasAdminTestJSON-322560292 None] Created volume successfully. Jul 22 01:53:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Acquiring lock "cinder-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "cinder-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Acquiring lock "cinder-quobyte-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "cinder-quobyte-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" acquired by "delete_volume" :: waited 0.055s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[926b94f9-c50b-4be2-8e39-db05eb09f736]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:53:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:27 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d Jul 22 01:53:27 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:27 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" returned: 0 in 0.603s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:27 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d Jul 22 01:53:27 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e3ae6f02-b26f-44aa-abc4-27e217280e32 tempest-VolumeQuotasAdminTestJSON-6565296 None] Transfer volume completed successfully. Jul 22 01:53:28 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" returned: 0 in 0.514s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "cinder-quobyte-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d" released by "delete_volume" :: held 1.204s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Created reservations ['1b557fe2-1daa-4bb5-b6ce-9be25b1dffe7', 'b662ef78-c5c8-4223-a8b3-7dcb28bb9290', '76854466-7cab-455f-b84b-7d57f63ce0dc', 'ab7ef4bf-e4ee-4b4c-89c2-8f887cd647c6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:28 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:53:28 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Acquiring lock "cinder-2df57e04-2f97-4653-8cf1-5839ef9763b5-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "cinder-2df57e04-2f97-4653-8cf1-5839ef9763b5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Acquiring lock "cinder-quobyte-2df57e04-2f97-4653-8cf1-5839ef9763b5" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "cinder-quobyte-2df57e04-2f97-4653-8cf1-5839ef9763b5" acquired by "delete_volume" :: waited 0.051s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb8daa-f44a-4a5e-8929-f3b7e4af014d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:29 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.560s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:53:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Deleted volume successfully. Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b25ea94-07ec-465e-947c-e8d376bb86ee tempest-ServerRescueNegativeTestJSON-1611289090 None] Lock "cinder-b3e2a110-7e8b-424f-a0e1-bd2429d11e4d-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:29 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 Jul 22 01:53:29 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:29 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5" returned: 0 in 0.646s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:29 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5 Jul 22 01:53:29 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:30 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2df57e04-2f97-4653-8cf1-5839ef9763b5" returned: 0 in 0.717s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "cinder-quobyte-2df57e04-2f97-4653-8cf1-5839ef9763b5" released by "delete_volume" :: held 1.459s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Created reservations ['45f65245-75c2-428a-bfb8-70fe118c8541', '4795e02d-148e-42a2-b508-59d1de9fdd6b', '850b2c65-02f2-439c-9ad3-845cc891abe4', '02c454b6-2e1f-4531-8b0d-d59c6edfebf5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:30 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:53:30 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:31 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.564s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:31 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:53:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Deleted volume successfully. Jul 22 01:53:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4c537e9f-06eb-48d2-aa56-21e99dbf63e9 tempest-VolumeQuotasAdminTestJSON-4607230 None] Lock "cinder-2df57e04-2f97-4653-8cf1-5839ef9763b5-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:53:40 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=29,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:53:41 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=25,cinder:UPDATE=44,cinder:DELETE=4,cinder:INSERT=7 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Flow 'volume_create_manager' (943b1b2e-94fe-4278-ac69-e4c43b2befb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0205888e-01ed-4c01-b77a-28977bb987a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0205888e-01ed-4c01-b77a-28977bb987a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1949655953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5a8dae-7ae0-4129-bcf7-60338ac6a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08bf1886911492fb0b9dc95d1b2ca1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:46Z,use_quota=True,user_id='97790ef311a34a8b957939e97eb7aff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6105bead-cf07-4eab-bde6-1bb102df4f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6105bead-cf07-4eab-bde6-1bb102df4f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd90a20-9681-43cf-9109-35d4642e9a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd90a20-9681-43cf-9109-35d4642e9a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'volume_name': 'volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb546766-ca8a-4fbf-a643-78547efdb48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb546766-ca8a-4fbf-a643-78547efdb48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc5c09a-0cac-45d8-a98b-025ddee7834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Volume aa5a8dae-7ae0-4129-bcf7-60338ac6a138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'volume_size': 1} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1949655953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5a8dae-7ae0-4129-bcf7-60338ac6a138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08bf1886911492fb0b9dc95d1b2ca1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:53:46Z,use_quota=True,user_id='97790ef311a34a8b957939e97eb7aff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Creating volume aa5a8dae-7ae0-4129-bcf7-60338ac6a138 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:53:46 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:53:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:46 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 1073741824 Jul 22 01:53:46 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:47 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 1073741824" returned: 0 in 0.843s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:47 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 Jul 22 01:53:47 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:47 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" returned: 0 in 0.358s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc5c09a-0cac-45d8-a98b-025ddee7834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a970f960-d77d-4c9b-8628-a1d3202a7f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:53:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Volume volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 (aa5a8dae-7ae0-4129-bcf7-60338ac6a138): created successfully Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a970f960-d77d-4c9b-8628-a1d3202a7f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:53:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Flow 'volume_create_manager' (943b1b2e-94fe-4278-ac69-e4c43b2befb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:53:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-68e4d1a8-3d56-412d-920f-1b7a33b2e9ce tempest-ServerActionsTestOtherA-15214672 None] Created volume successfully. Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:53:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:53:52 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:53:52 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:53:52 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Jul 22 01:53:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.562s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:53:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:53:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:53:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:53:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:53:57 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:53:57 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:54:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cfc191c5-839b-4c92-8927-55cb8a0a5c57 req-8dcd462b-cfe3-4210-b6ec-9ecab967b5bd tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cfc191c5-839b-4c92-8927-55cb8a0a5c57 req-8dcd462b-cfe3-4210-b6ec-9ecab967b5bd tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cfc191c5-839b-4c92-8927-55cb8a0a5c57 req-8dcd462b-cfe3-4210-b6ec-9ecab967b5bd tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cfc191c5-839b-4c92-8927-55cb8a0a5c57 req-8dcd462b-cfe3-4210-b6ec-9ecab967b5bd tempest-ServerActionsTestOtherA-15214672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0fb7573-265e-4729-867a-574b54ba06de', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:54:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-cfc191c5-839b-4c92-8927-55cb8a0a5c57 req-8dcd462b-cfe3-4210-b6ec-9ecab967b5bd tempest-ServerActionsTestOtherA-15214672 None] attachment_update completed successfully. Jul 22 01:54:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-208c2b8a-fd31-434b-9364-3824ad5eaba9 tempest-ServerActionsTestOtherA-15214672 None] Terminate volume connection completed successfully. Jul 22 01:54:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-208c2b8a-fd31-434b-9364-3824ad5eaba9 tempest-ServerActionsTestOtherA-15214672 None] Deleting attachment c0fb7573-265e-4729-867a-574b54ba06de. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:54:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-0763e5aa-06fc-4b50-9a36-1e842090b477 tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-0763e5aa-06fc-4b50-9a36-1e842090b477 tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-0763e5aa-06fc-4b50-9a36-1e842090b477 tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-0763e5aa-06fc-4b50-9a36-1e842090b477 tempest-ServerActionsTestOtherA-15214672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e23d929-b441-4751-9735-9ebc1d2eba12', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:54:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-a4581c44-a81f-4c43-8627-3edfc0b00673 req-0763e5aa-06fc-4b50-9a36-1e842090b477 tempest-ServerActionsTestOtherA-15214672 None] attachment_update completed successfully. Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Flow 'volume_create_manager' (f987b339-026b-406c-a5d4-a1b035f835b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af90515-b8af-46c8-b700-5dec671efe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af90515-b8af-46c8-b700-5dec671efe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1416376474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282a9b02-2263-45ea-b563-edc2ce8e0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb5b887d194584a8781e4881ba6634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:39Z,use_quota=True,user_id='04c30f0f273b40a08a64c3f4cc75d0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb517ba-429b-44ad-803b-48e27f953290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb517ba-429b-44ad-803b-48e27f953290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a819c0-ad94-4109-97eb-9101a3b69faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a819c0-ad94-4109-97eb-9101a3b69faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282a9b02-2263-45ea-b563-edc2ce8e0867', 'volume_name': 'volume-282a9b02-2263-45ea-b563-edc2ce8e0867', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5313491f-cbbf-4e55-8854-aa405ba52cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5313491f-cbbf-4e55-8854-aa405ba52cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447b8641-2cc9-4fb8-90be-2c10726db766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:39 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Volume 282a9b02-2263-45ea-b563-edc2ce8e0867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282a9b02-2263-45ea-b563-edc2ce8e0867', 'volume_size': 1} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1416376474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282a9b02-2263-45ea-b563-edc2ce8e0867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb5b887d194584a8781e4881ba6634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:39Z,use_quota=True,user_id='04c30f0f273b40a08a64c3f4cc75d0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Creating volume 282a9b02-2263-45ea-b563-edc2ce8e0867 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:54:39 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:54:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:39 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 1073741824 Jul 22 01:54:39 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:39 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 1073741824" returned: 0 in 0.608s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:40 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 Jul 22 01:54:40 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:40 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867" returned: 0 in 0.878s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:54:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447b8641-2cc9-4fb8-90be-2c10726db766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282a9b02-2263-45ea-b563-edc2ce8e0867', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5ed438-e02d-4e87-a5be-f242a502ae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:41 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Volume volume-282a9b02-2263-45ea-b563-edc2ce8e0867 (282a9b02-2263-45ea-b563-edc2ce8e0867): created successfully Jul 22 01:54:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5ed438-e02d-4e87-a5be-f242a502ae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Flow 'volume_create_manager' (f987b339-026b-406c-a5d4-a1b035f835b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d95d36d1-0a6e-4ef8-b352-8612c4e3275a tempest-AttachVolumeShelveTestJSON-1740254602 None] Created volume successfully. Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (313fb016-82f4-4dc7-a41e-37f0f897e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9aa9e1-1d02-4e05-a332-cc2e287e1529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9aa9e1-1d02-4e05-a332-cc2e287e1529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533164350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018f67ef-a5c5-4b79-8aca-3cdc918b32ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:45Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1420ba6-3088-4638-9693-a4d8215e72e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1420ba6-3088-4638-9693-a4d8215e72e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27eccb3b-aea4-4595-afd5-ac63389dc06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27eccb3b-aea4-4595-afd5-ac63389dc06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018f67ef-a5c5-4b79-8aca-3cdc918b32ed', 'volume_name': 'volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1456c4-ddad-4d73-be2a-fb955ac15af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1456c4-ddad-4d73-be2a-fb955ac15af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d139a9b0-16eb-423f-888f-6388511037d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Volume 018f67ef-a5c5-4b79-8aca-3cdc918b32ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed', 'volume_size': 1} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533164350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018f67ef-a5c5-4b79-8aca-3cdc918b32ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:45Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Creating volume 018f67ef-a5c5-4b79-8aca-3cdc918b32ed {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:54:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:54:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:45 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed 1073741824 Jul 22 01:54:45 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:46 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed 1073741824" returned: 0 in 0.592s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:46 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed Jul 22 01:54:46 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:46 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" returned: 0 in 0.530s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d139a9b0-16eb-423f-888f-6388511037d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2fe6ef-67f3-4bdb-9304-d0e564a7301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Volume volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed (018f67ef-a5c5-4b79-8aca-3cdc918b32ed): created successfully Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2fe6ef-67f3-4bdb-9304-d0e564a7301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (313fb016-82f4-4dc7-a41e-37f0f897e643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:46 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-87d9e05a-ed53-4103-812d-0d6df4d1d8d3 tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:54:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-066cbd2f-7091-427b-b964-349bebc9492c tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" by "attach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-066cbd2f-7091-427b-b964-349bebc9492c tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" acquired by "attach_volume" :: waited 0.051s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-066cbd2f-7091-427b-b964-349bebc9492c tempest-VolumesActionsTest-1194267562 None] Attaching volume 018f67ef-a5c5-4b79-8aca-3cdc918b32ed to instance 08f84a0b-83e7-4280-a355-309b9f745593 at mountpoint /dev/vdb on host None. Jul 22 01:54:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-066cbd2f-7091-427b-b964-349bebc9492c tempest-VolumesActionsTest-1194267562 None] Attach volume completed successfully. Jul 22 01:54:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-066cbd2f-7091-427b-b964-349bebc9492c tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" released by "attach_volume" :: held 0.280s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:54:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Terminate volume connection completed successfully. Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" by "detach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Detaching volume 018f67ef-a5c5-4b79-8aca-3cdc918b32ed from instance 08f84a0b-83e7-4280-a355-309b9f745593. Jul 22 01:54:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Detach volume completed successfully. Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-169e2b60-31af-4c7b-858e-14e13d7100ec tempest-VolumesActionsTest-964800990 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6f57caf-87e2-4ba2-8e3d-2c91a5e452d9 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" by "detach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6f57caf-87e2-4ba2-8e3d-2c91a5e452d9 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a6f57caf-87e2-4ba2-8e3d-2c91a5e452d9 tempest-VolumesActionsTest-1194267562 None] Volume detach called, but volume not attached. Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6f57caf-87e2-4ba2-8e3d-2c91a5e452d9 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:54:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-quobyte-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-quobyte-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0598a7f-f4d0-427a-97ec-373e2cc6fd82]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:50 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed Jul 22 01:54:50 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:50 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" returned: 0 in 0.543s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:50 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed Jul 22 01:54:50 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:51 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" returned: 0 in 0.557s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-quobyte-018f67ef-a5c5-4b79-8aca-3cdc918b32ed" released by "delete_volume" :: held 1.185s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Created reservations ['33918083-b669-46d9-a0d0-91bdba2978eb', '0ed480fd-5732-47df-b966-6b521d1d560a', '1544f553-58d8-43c5-9a4a-a0beb62cc399', 'baacc38b-4357-42f5-96c1-b4909e70b755'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:51 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:54:51 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (21a04866-b152-4cc8-ad02-ee6c5dc51b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f2419-e56a-4db9-8895-8ae0b42d8327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36f2419-e56a-4db9-8895-8ae0b42d8327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1619060193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f4a415-4b53-4139-ab00-59673694df8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:52Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817724f-53df-4c5b-b47d-9cd9cd0adf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817724f-53df-4c5b-b47d-9cd9cd0adf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2843e9-568d-4ba7-b820-7540d0cc48be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2843e9-568d-4ba7-b820-7540d0cc48be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f4a415-4b53-4139-ab00-59673694df8f', 'volume_name': 'volume-f0f4a415-4b53-4139-ab00-59673694df8f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c9f89c-ccfc-426e-b7b3-7bb2fbacec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c9f89c-ccfc-426e-b7b3-7bb2fbacec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf69f3c8-456f-4bbf-844e-f06a573a1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Volume f0f4a415-4b53-4139-ab00-59673694df8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f4a415-4b53-4139-ab00-59673694df8f', 'volume_size': 1} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1619060193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f4a415-4b53-4139-ab00-59673694df8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:52Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Creating volume f0f4a415-4b53-4139-ab00-59673694df8f {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:54:51 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:54:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:51 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f 1073741824 Jul 22 01:54:51 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:52 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.781s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:54:52 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:54:52 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Deleted volume successfully. Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe19c38d-2acc-471e-bf9e-65214523da84 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-018f67ef-a5c5-4b79-8aca-3cdc918b32ed-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:54:52 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f 1073741824" returned: 0 in 0.934s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:52 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.458s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:54:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:53 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f Jul 22 01:54:53 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:53 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f" returned: 0 in 0.762s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf69f3c8-456f-4bbf-844e-f06a573a1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f4a415-4b53-4139-ab00-59673694df8f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32ceb94-04eb-4aa2-9976-e70d5d6b4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Volume volume-f0f4a415-4b53-4139-ab00-59673694df8f (f0f4a415-4b53-4139-ab00-59673694df8f): created successfully Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32ceb94-04eb-4aa2-9976-e70d5d6b4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (21a04866-b152-4cc8-ad02-ee6c5dc51b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-47648400-965d-469d-882d-0b34ed82bce1 tempest-AttachVolumeTestJSON-341495569 None] Created volume successfully. Jul 22 01:54:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-df2e45af-abd7-4f28-b441-a19f7c2e6644 req-980c46a5-b19a-4b7f-b3ce-1a113480e4c1 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-df2e45af-abd7-4f28-b441-a19f7c2e6644 req-980c46a5-b19a-4b7f-b3ce-1a113480e4c1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-df2e45af-abd7-4f28-b441-a19f7c2e6644 req-980c46a5-b19a-4b7f-b3ce-1a113480e4c1 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-df2e45af-abd7-4f28-b441-a19f7c2e6644 req-980c46a5-b19a-4b7f-b3ce-1a113480e4c1 tempest-AttachVolumeTestJSON-341495569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-f0f4a415-4b53-4139-ab00-59673694df8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87cd8241-80e5-4a3c-9530-9e59f452217c', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:54:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-df2e45af-abd7-4f28-b441-a19f7c2e6644 req-980c46a5-b19a-4b7f-b3ce-1a113480e4c1 tempest-AttachVolumeTestJSON-341495569 None] attachment_update completed successfully. Jul 22 01:54:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-43e62219-c4ec-42ed-b99d-a6c7a5dfc7ed req-cdf726ce-b63a-4665-b24c-02ca45941387 tempest-AttachVolumeShelveTestJSON-1740254602 None] No connector for attachment 16fa080d-c485-4a88-ba49-e8ee4d5d4915; skipping storage backend terminate_connection call. {{(pid=87153) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 22 01:54:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-43e62219-c4ec-42ed-b99d-a6c7a5dfc7ed req-cdf726ce-b63a-4665-b24c-02ca45941387 tempest-AttachVolumeShelveTestJSON-1740254602 None] Deleting attachment 16fa080d-c485-4a88-ba49-e8ee4d5d4915. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (f306492a-567e-4bad-966c-eb5a128499ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2da0167-1439-4366-be3b-506aead04db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2da0167-1439-4366-be3b-506aead04db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839275438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbade0b-ef49-4774-aec6-6c4016b81d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:57Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadd40aa-3db4-488e-8f66-52b352127ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadd40aa-3db4-488e-8f66-52b352127ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d688e-b02e-4816-adb7-63b4d1cd2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d688e-b02e-4816-adb7-63b4d1cd2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbade0b-ef49-4774-aec6-6c4016b81d9b', 'volume_name': 'volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d0edf-4a2b-41e9-9fd2-5c71246a6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750d0edf-4a2b-41e9-9fd2-5c71246a6751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b1b7d5-8440-4a47-8df2-1d8c11910016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Volume 4cbade0b-ef49-4774-aec6-6c4016b81d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b', 'volume_size': 1} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839275438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbade0b-ef49-4774-aec6-6c4016b81d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:54:57Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Creating volume 4cbade0b-ef49-4774-aec6-6c4016b81d9b {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:54:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:57 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b 1073741824 Jul 22 01:54:57 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:57 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b 1073741824" returned: 0 in 0.567s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:57 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b Jul 22 01:54:57 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:58 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b1b7d5-8440-4a47-8df2-1d8c11910016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e99ed3-0a18-476a-bd42-38156417faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:54:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Volume volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b (4cbade0b-ef49-4774-aec6-6c4016b81d9b): created successfully Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e99ed3-0a18-476a-bd42-38156417faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:54:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (f306492a-567e-4bad-966c-eb5a128499ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:54:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c66e8207-7a8b-48b4-aaf4-7f68784757c4 tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-4cbade0b-ef49-4774-aec6-6c4016b81d9b-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "cinder-4cbade0b-ef49-4774-aec6-6c4016b81d9b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-quobyte-4cbade0b-ef49-4774-aec6-6c4016b81d9b" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-4cbade0b-ef49-4774-aec6-6c4016b81d9b" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc01582-6444-4c6b-84cf-ec4dc3464601]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:54:59 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b Jul 22 01:54:59 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:54:59 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b" returned: 0 in 0.430s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:54:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:00 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b Jul 22 01:55:00 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:00 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4cbade0b-ef49-4774-aec6-6c4016b81d9b" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-4cbade0b-ef49-4774-aec6-6c4016b81d9b" released by "delete_volume" :: held 0.824s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Created reservations ['1be3ec40-3842-4286-9ecd-3610bd6bbe27', '848aa1dd-e6ea-41e7-8eef-338241a73717', 'd7102a8e-6d5b-4847-9c5a-dc3e9aea8f38', 'c852c20f-0e11-4d85-93af-c8f1feb69218'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:00 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:00 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:01 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.543s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Deleted volume successfully. Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-aac32d47-5786-410e-b9d5-52be10073237 tempest-VolumesActionsTest-964800990 None] Lock "cinder-4cbade0b-ef49-4774-aec6-6c4016b81d9b-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (cf0829eb-1672-4a74-94ab-be9ca9275c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4751d764-f797-4f58-b60b-622e3df2d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4751d764-f797-4f58-b60b-622e3df2d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197579801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdbce54-d6de-4314-91ca-43b8fef73084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:02Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bf112e-de40-4c7e-b16e-66f8364f3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bf112e-de40-4c7e-b16e-66f8364f3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92109391-961d-4f33-86e9-7468af250579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92109391-961d-4f33-86e9-7468af250579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdbce54-d6de-4314-91ca-43b8fef73084', 'volume_name': 'volume-ccdbce54-d6de-4314-91ca-43b8fef73084', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b753b477-dfef-4f7f-ae37-38ae7ce73155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b753b477-dfef-4f7f-ae37-38ae7ce73155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece22f35-7d68-4838-97b0-a428f1dc51fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Volume ccdbce54-d6de-4314-91ca-43b8fef73084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdbce54-d6de-4314-91ca-43b8fef73084', 'volume_size': 1} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197579801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdbce54-d6de-4314-91ca-43b8fef73084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:02Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Creating volume ccdbce54-d6de-4314-91ca-43b8fef73084 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:01 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:01 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 1073741824 Jul 22 01:55:01 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:02 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 1073741824" returned: 0 in 1.047s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:03 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 Jul 22 01:55:03 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:03 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084" returned: 0 in 0.424s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece22f35-7d68-4838-97b0-a428f1dc51fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdbce54-d6de-4314-91ca-43b8fef73084', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785661ce-53bd-4e02-9896-8068cb4a3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:03 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Volume volume-ccdbce54-d6de-4314-91ca-43b8fef73084 (ccdbce54-d6de-4314-91ca-43b8fef73084): created successfully Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785661ce-53bd-4e02-9896-8068cb4a3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (cf0829eb-1672-4a74-94ab-be9ca9275c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a29cd57e-83f2-436b-b583-ed2449b41c38 tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-ccdbce54-d6de-4314-91ca-43b8fef73084-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "cinder-ccdbce54-d6de-4314-91ca-43b8fef73084-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-quobyte-ccdbce54-d6de-4314-91ca-43b8fef73084" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-ccdbce54-d6de-4314-91ca-43b8fef73084" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a35a9a-9cc1-4b32-b77b-37775a532297]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:04 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 Jul 22 01:55:04 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:05 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084" returned: 0 in 0.547s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:05 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084 Jul 22 01:55:05 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:05 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccdbce54-d6de-4314-91ca-43b8fef73084" returned: 0 in 0.347s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-ccdbce54-d6de-4314-91ca-43b8fef73084" released by "delete_volume" :: held 0.987s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Created reservations ['c244767a-ee62-41ac-a52c-d5b8854a3802', 'fde73866-49ed-406b-b30e-b6256d2f51dd', '32f3d87a-376f-43e4-aeba-045c22a0d07e', '3564ab63-72b2-4cbc-8ab3-2ab51a5c3a7a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:05 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:05 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:06 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.461s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Deleted volume successfully. Jul 22 01:55:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-50b57d80-8f76-4e84-8055-7b252d4b8b88 tempest-VolumesActionsTest-964800990 None] Lock "cinder-ccdbce54-d6de-4314-91ca-43b8fef73084-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (551b42bb-2a26-49f7-a4b9-088735e66f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74349060-9a84-4824-8307-f5e0a77313c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74349060-9a84-4824-8307-f5e0a77313c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-248919414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf87ce2-1eaa-4410-bb5a-aec3a4557518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:07Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4ac98b-8fd1-4563-84ba-158881900514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4ac98b-8fd1-4563-84ba-158881900514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd4e02d-b3ce-4cde-9415-e9a5ac6bf91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd4e02d-b3ce-4cde-9415-e9a5ac6bf91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf87ce2-1eaa-4410-bb5a-aec3a4557518', 'volume_name': 'volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b63819-2389-4671-9042-f9a2e11f9ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b63819-2389-4671-9042-f9a2e11f9ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bfcea5-07c6-45af-a058-458d5e47fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Volume 2bf87ce2-1eaa-4410-bb5a-aec3a4557518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518', 'volume_size': 1} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-248919414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf87ce2-1eaa-4410-bb5a-aec3a4557518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:07Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Creating volume 2bf87ce2-1eaa-4410-bb5a-aec3a4557518 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:07 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:07 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 1073741824 Jul 22 01:55:07 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:08 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 1073741824" returned: 0 in 0.872s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:08 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 Jul 22 01:55:08 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:09 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" returned: 0 in 0.680s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bfcea5-07c6-45af-a058-458d5e47fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a56268c-05e6-4021-a8b8-9bec1344a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:09 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Volume volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 (2bf87ce2-1eaa-4410-bb5a-aec3a4557518): created successfully Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a56268c-05e6-4021-a8b8-9bec1344a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (551b42bb-2a26-49f7-a4b9-088735e66f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-88059b89-d1ce-4819-b62a-f246ae032f8a tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-2bf87ce2-1eaa-4410-bb5a-aec3a4557518-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "cinder-2bf87ce2-1eaa-4410-bb5a-aec3a4557518-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-quobyte-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3622175c-f646-40cb-8043-3f51b75a059e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:10 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 Jul 22 01:55:10 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:11 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" returned: 0 in 0.786s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:11 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518 Jul 22 01:55:11 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:11 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-2bf87ce2-1eaa-4410-bb5a-aec3a4557518" released by "delete_volume" :: held 1.123s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Created reservations ['6e8418b1-d890-4ca2-b48d-6d2bf29cd87a', '47ba47f3-d9ec-4ba4-acf3-bde6235c0bfc', 'f2d7c1f4-ed84-4582-818d-43f49c780eca', 'e3156ab0-03d4-47d5-b4c4-60c11340cd04'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:11 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:11 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:11 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Deleted volume successfully. Jul 22 01:55:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2b2f8be7-9098-40bb-9f2f-bd8c0ec056d3 tempest-VolumesActionsTest-964800990 None] Lock "cinder-2bf87ce2-1eaa-4410-bb5a-aec3a4557518-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (c689eeb8-86c9-44dd-9d74-8d7353ea7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5127014e-c0e0-4d78-8ef3-547c7a830908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5127014e-c0e0-4d78-8ef3-547c7a830908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008197826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe0af42-d012-479d-833c-430f1c6ce39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:13Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c477f92b-4936-4645-be5f-209770599d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c477f92b-4936-4645-be5f-209770599d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af1a712-c330-4938-8b90-ef577edad15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af1a712-c330-4938-8b90-ef577edad15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe0af42-d012-479d-833c-430f1c6ce39b', 'volume_name': 'volume-bfe0af42-d012-479d-833c-430f1c6ce39b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f828129d-c598-40b7-aaa3-c8db5550e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f828129d-c598-40b7-aaa3-c8db5550e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79be104e-65c6-4296-8102-f9bdc230233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Volume bfe0af42-d012-479d-833c-430f1c6ce39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe0af42-d012-479d-833c-430f1c6ce39b', 'volume_size': 1} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008197826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe0af42-d012-479d-833c-430f1c6ce39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:13Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Creating volume bfe0af42-d012-479d-833c-430f1c6ce39b {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:13 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:13 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b 1073741824 Jul 22 01:55:13 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:13 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b 1073741824" returned: 0 in 0.492s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:13 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b Jul 22 01:55:13 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:13 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79be104e-65c6-4296-8102-f9bdc230233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe0af42-d012-479d-833c-430f1c6ce39b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fc4bc4-2583-4449-9b56-b9087edeae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Volume volume-bfe0af42-d012-479d-833c-430f1c6ce39b (bfe0af42-d012-479d-833c-430f1c6ce39b): created successfully Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fc4bc4-2583-4449-9b56-b9087edeae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (c689eeb8-86c9-44dd-9d74-8d7353ea7970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8539e12b-13cb-45e9-b4a2-ec7d6a2d662f tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-bfe0af42-d012-479d-833c-430f1c6ce39b-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "cinder-bfe0af42-d012-479d-833c-430f1c6ce39b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Acquiring lock "cinder-quobyte-bfe0af42-d012-479d-833c-430f1c6ce39b" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-bfe0af42-d012-479d-833c-430f1c6ce39b" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8dd83-c6f6-43a8-b6cb-6b1f1f6b5afd]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:15 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b Jul 22 01:55:15 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:15 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:15 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b Jul 22 01:55:15 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:15 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bfe0af42-d012-479d-833c-430f1c6ce39b" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "cinder-quobyte-bfe0af42-d012-479d-833c-430f1c6ce39b" released by "delete_volume" :: held 0.663s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Created reservations ['f94e6a56-2f7c-4016-9fd1-87195132afec', 'ebdeb1f2-d582-48e1-88b7-6150d23f78a3', '4c7c30df-769d-4fb4-aa1a-f71ca10520b2', 'e67aff59-4671-4ccc-ad47-0cb8ed2185f3'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:16 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:16 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:16 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.261s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Deleted volume successfully. Jul 22 01:55:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce301ee9-e45c-4e34-a7d1-13af2330a082 tempest-VolumesActionsTest-964800990 None] Lock "cinder-bfe0af42-d012-479d-833c-430f1c6ce39b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (b3463672-2234-41b4-be36-afa1d55f54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca70b72-1e93-4276-9fb0-62976a4bc979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca70b72-1e93-4276-9fb0-62976a4bc979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-740984824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fdeb67-b62a-420d-b829-db6d3c15ee98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:17Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0128eee-ce97-4ded-80a0-f4b0de067f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0128eee-ce97-4ded-80a0-f4b0de067f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5831411-30dc-4ae2-82ee-f5974c74bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5831411-30dc-4ae2-82ee-f5974c74bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fdeb67-b62a-420d-b829-db6d3c15ee98', 'volume_name': 'volume-94fdeb67-b62a-420d-b829-db6d3c15ee98', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fe9e8a-4c36-4279-884d-5a4800ae7937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fe9e8a-4c36-4279-884d-5a4800ae7937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6b9e9b-c01f-45b6-9fa0-af9286a07a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Volume 94fdeb67-b62a-420d-b829-db6d3c15ee98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fdeb67-b62a-420d-b829-db6d3c15ee98', 'volume_size': 1} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-740984824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fdeb67-b62a-420d-b829-db6d3c15ee98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61fe43872a943cd94b400d7ae77dd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:17Z,use_quota=True,user_id='0c6c2892bc3e46e697568c59b9b82ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Creating volume 94fdeb67-b62a-420d-b829-db6d3c15ee98 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:17 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:17 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 1073741824 Jul 22 01:55:17 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:17 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 1073741824" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:17 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 Jul 22 01:55:17 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:17 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6b9e9b-c01f-45b6-9fa0-af9286a07a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fdeb67-b62a-420d-b829-db6d3c15ee98', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d2280-8168-4322-98e7-9ea18aeed895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Volume volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 (94fdeb67-b62a-420d-b829-db6d3c15ee98): created successfully Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7d2280-8168-4322-98e7-9ea18aeed895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Flow 'volume_create_manager' (b3463672-2234-41b4-be36-afa1d55f54bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-939c1b5b-3f8f-4d05-9513-5a0902296626 tempest-VolumesActionsTest-1194267562 None] Created volume successfully. Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-94fdeb67-b62a-420d-b829-db6d3c15ee98-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-94fdeb67-b62a-420d-b829-db6d3c15ee98-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "cinder-quobyte-94fdeb67-b62a-420d-b829-db6d3c15ee98" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-quobyte-94fdeb67-b62a-420d-b829-db6d3c15ee98" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cae682d-7995-4afd-8fb3-30d6aaf33b09]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:18 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 Jul 22 01:55:18 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:19 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98" returned: 0 in 0.402s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:19 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98 Jul 22 01:55:19 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:19 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-94fdeb67-b62a-420d-b829-db6d3c15ee98" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-quobyte-94fdeb67-b62a-420d-b829-db6d3c15ee98" released by "delete_volume" :: held 0.725s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Created reservations ['0e78bd8b-debe-449e-a4c8-2e5ff3184561', '6dd0b2d3-4ada-4eea-b1e7-c5f3d92a4777', '47c9358d-6006-4b3b-a93a-ca9a1e835c8b', 'cfc9e2f1-bb7d-4bb7-8727-46e1ba0e324b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:19 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:19 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:19 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Deleted volume successfully. Jul 22 01:55:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-79f81c31-c894-424a-b321-b0804ac1f1a7 tempest-VolumesActionsTest-1194267562 None] Lock "cinder-94fdeb67-b62a-420d-b829-db6d3c15ee98-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3ed27630-b468-4dfc-b6a0-e73c750e0115 req-17cc681a-bdf9-4e9e-935b-34fa80483933 tempest-ServerActionsTestOtherA-15214672 None] Terminate volume connection completed successfully. Jul 22 01:55:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3ed27630-b468-4dfc-b6a0-e73c750e0115 req-17cc681a-bdf9-4e9e-935b-34fa80483933 tempest-ServerActionsTestOtherA-15214672 None] Deleting attachment 5e23d929-b441-4751-9735-9ebc1d2eba12. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "cinder-aa5a8dae-7ae0-4129-bcf7-60338ac6a138-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "cinder-aa5a8dae-7ae0-4129-bcf7-60338ac6a138-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "cinder-quobyte-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "cinder-quobyte-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e46f3b9-063e-4118-9c2a-c5cd1954e82b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:25 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 Jul 22 01:55:25 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:25 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" returned: 0 in 0.443s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:25 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138 Jul 22 01:55:25 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-d5ff2751-da65-4b94-814d-cd721485ce0c req-0f0806e7-76dc-450c-ad9e-121b4a8cfd92 tempest-AttachVolumeTestJSON-341495569 None] Terminate volume connection completed successfully. Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-d5ff2751-da65-4b94-814d-cd721485ce0c req-0f0806e7-76dc-450c-ad9e-121b4a8cfd92 tempest-AttachVolumeTestJSON-341495569 None] Deleting attachment 87cd8241-80e5-4a3c-9530-9e59f452217c. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:55:26 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" returned: 0 in 0.346s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "cinder-quobyte-aa5a8dae-7ae0-4129-bcf7-60338ac6a138" released by "delete_volume" :: held 0.832s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Created reservations ['1ef2e439-62b3-4633-8586-3b54468400d6', '36c5c9a4-d4d9-45e0-bf42-5f408bcff12d', '335d308b-8183-4a3e-a56e-de339c8f7e44', '08f23740-7b51-4a7f-a0d5-8d7b25ba86d1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:26 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:26 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:26 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Deleted volume successfully. Jul 22 01:55:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d22785d1-5a14-442f-8f24-d389e903150d tempest-ServerActionsTestOtherA-15214672 None] Lock "cinder-aa5a8dae-7ae0-4129-bcf7-60338ac6a138-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:36 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=78,cinder:UPDATE=85,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:55:36 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=87,cinder:UPDATE=92,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Acquiring lock "cinder-282a9b02-2263-45ea-b563-edc2ce8e0867-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "cinder-282a9b02-2263-45ea-b563-edc2ce8e0867-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Acquiring lock "cinder-quobyte-282a9b02-2263-45ea-b563-edc2ce8e0867" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "cinder-quobyte-282a9b02-2263-45ea-b563-edc2ce8e0867" acquired by "delete_volume" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71fadfa-3639-4b68-93c1-5d196dca0952]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:39 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 Jul 22 01:55:39 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:40 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867" returned: 0 in 0.585s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:40 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867 Jul 22 01:55:40 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:40 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-282a9b02-2263-45ea-b563-edc2ce8e0867" returned: 0 in 0.324s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "cinder-quobyte-282a9b02-2263-45ea-b563-edc2ce8e0867" released by "delete_volume" :: held 0.958s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Created reservations ['e84b6272-edac-4774-8871-5b8f6e30df37', '16ac1157-9005-4221-801a-f2a39726f5c4', 'fbbaf7c2-a398-4bfc-99df-2379f6d3692b', 'bfed7b54-76de-4e8c-bf78-c6aea2697977'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:40 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:40 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:41 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:41 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Deleted volume successfully. Jul 22 01:55:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a57ac612-28a5-49c5-ae41-dc5c82a5c7bf tempest-AttachVolumeShelveTestJSON-1740254602 None] Lock "cinder-282a9b02-2263-45ea-b563-edc2ce8e0867-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Flow 'volume_create_manager' (b2547ccb-1dd1-4db7-b23b-4a36876e144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ea79d4-eb75-4cec-a66e-b55bdf684741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ea79d4-eb75-4cec-a66e-b55bdf684741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1975760539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5ec8be-74d3-45f1-9c76-187be0a80080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1062f91c430431ca322504e3b445bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:44Z,use_quota=True,user_id='9f89bc1997e148e5bec57e0bd4c533b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb8687-6b2e-481a-9057-95c5ec476f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cb8687-6b2e-481a-9057-95c5ec476f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782db825-9e35-4331-a73f-e54de4017e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782db825-9e35-4331-a73f-e54de4017e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5ec8be-74d3-45f1-9c76-187be0a80080', 'volume_name': 'volume-da5ec8be-74d3-45f1-9c76-187be0a80080', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283e8e65-4627-4f01-9b00-4b0f3e16e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283e8e65-4627-4f01-9b00-4b0f3e16e078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106a013-0558-41a2-ad22-ba6f021f22be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:44 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Volume da5ec8be-74d3-45f1-9c76-187be0a80080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5ec8be-74d3-45f1-9c76-187be0a80080', 'volume_size': 1} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1975760539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5ec8be-74d3-45f1-9c76-187be0a80080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1062f91c430431ca322504e3b445bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:44Z,use_quota=True,user_id='9f89bc1997e148e5bec57e0bd4c533b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Creating volume da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:44 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:44 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 1073741824 Jul 22 01:55:44 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:45 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 1073741824" returned: 0 in 0.507s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:45 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:55:45 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:45 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106a013-0558-41a2-ad22-ba6f021f22be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5ec8be-74d3-45f1-9c76-187be0a80080', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d225d866-de6f-4581-9ef8-6ba01516c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Volume volume-da5ec8be-74d3-45f1-9c76-187be0a80080 (da5ec8be-74d3-45f1-9c76-187be0a80080): created successfully Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d225d866-de6f-4581-9ef8-6ba01516c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Flow 'volume_create_manager' (b2547ccb-1dd1-4db7-b23b-4a36876e144d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6bf17d9e-183b-42e0-b3a0-69380b3a6954 tempest-VolumesCloneTest-954559856 None] Created volume successfully. Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Flow 'volume_create_manager' (648c858a-1374-4897-b6ec-c036a00a6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297312ec-0030-4058-ad08-3d5746789036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297312ec-0030-4058-ad08-3d5746789036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1458766426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65354f-c52f-4a0b-bc62-c499bb67b088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1062f91c430431ca322504e3b445bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=da5ec8be-74d3-45f1-9c76-187be0a80080,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:48Z,use_quota=True,user_id='9f89bc1997e148e5bec57e0bd4c533b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e341fa-7236-412c-ba21-f05500cc7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e341fa-7236-412c-ba21-f05500cc7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78eaea-d2ec-46c7-935a-7b527fda7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78eaea-d2ec-46c7-935a-7b527fda7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dd65354f-c52f-4a0b-bc62-c499bb67b088', 'volume_name': 'volume-dd65354f-c52f-4a0b-bc62-c499bb67b088', 'volume_size': 2, 'source_volid': 'da5ec8be-74d3-45f1-9c76-187be0a80080', 'source_volstatus': 'available'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618848b5-8198-4a5c-8df9-43fd54f27608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618848b5-8198-4a5c-8df9-43fd54f27608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba26082-b814-4aba-89d2-aa49d0eb9860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Volume dd65354f-c52f-4a0b-bc62-c499bb67b088: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dd65354f-c52f-4a0b-bc62-c499bb67b088', 'volume_size': 2, 'source_volid': 'da5ec8be-74d3-45f1-9c76-187be0a80080', 'source_volstatus': 'available'} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:47 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Cloning volume da5ec8be-74d3-45f1-9c76-187be0a80080 to volume dd65354f-c52f-4a0b-bc62-c499bb67b088 Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Creating offline snapshot e557755e-9bc3-4270-b7b7-090b5759ea9d of volume da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c1f877-e195-4d17-8bac-1f27bf8a1f30]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:48 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:55:48 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:48 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:48 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d 1G Jul 22 01:55:48 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:48 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d 1G" returned: 0 in 0.529s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5ec8be-74d3-45f1-9c76-187be0a80080 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:48 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5ec8be-74d3-45f1-9c76-187be0a80080 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:48 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:49 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da5ec8be-74d3-45f1-9c76-187be0a80080 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.312s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:49 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d is being set with open permissions: ugo+rw Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:49 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:49 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:49 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.269s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:49 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info Jul 22 01:55:49 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:49 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:49 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info is being set with open permissions: ugo+rw Jul 22 01:55:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:49 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info Jul 22 01:55:49 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:50 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.info" returned: 0 in 0.303s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] snapshot: e557755e-9bc3-4270-b7b7-090b5759ea9d, volume: dd65354f-c52f-4a0b-bc62-c499bb67b088, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea1a62-6b2e-4c87-8210-20c71f4b6527]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:50 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:50 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:50 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.396s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da5ec8be-74d3-45f1-9c76-187be0a80080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0dd687-c516-4beb-9adc-44351f994a28]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:50 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:55:50 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:51 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.375s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:51 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 01:55:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:51 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 Jul 22 01:55:51 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:52 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:55:52 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Flow 'volume_create_manager' (7fae42bc-6241-4cb2-8fb7-2dedd86bb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32389c5-aebf-40d3-8a27-0080b80aa997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32389c5-aebf-40d3-8a27-0080b80aa997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96922207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab59f44e-846f-474f-b774-b2d3feffdd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320a129f686540e7ac7224711a3b487b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:53Z,use_quota=True,user_id='542bd21f8a8b49a38f7f9ba8cfdbb6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f63f1e5-5760-4f9a-aaf7-2de08eb913b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f63f1e5-5760-4f9a-aaf7-2de08eb913b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb26c0-552f-4d2f-9180-c91f2ea20f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:53 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb26c0-552f-4d2f-9180-c91f2ea20f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab59f44e-846f-474f-b774-b2d3feffdd24', 'volume_name': 'volume-ab59f44e-846f-474f-b774-b2d3feffdd24', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77378f97-758a-4beb-9963-47f25cc3d185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77378f97-758a-4beb-9963-47f25cc3d185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bb0cac-efd6-4a34-995c-a3d349bb010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Volume ab59f44e-846f-474f-b774-b2d3feffdd24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab59f44e-846f-474f-b774-b2d3feffdd24', 'volume_size': 1} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.724s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:55:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:55:56 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088" returned: 0 in 5.728s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66a19bd-aef7-4a43-9bb9-316a457cbc0b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:56 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:55:56 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:57 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.594s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 01:55:57 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Converted 1024.00 MB image at 178.74 MB/s Jul 22 01:55:57 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 is being set with open permissions: ugo+rw Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:57 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 Jul 22 01:55:57 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:57 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" released by "_copy_volume_from_snapshot" :: held 7.437s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-quobyte-e557755e-9bc3-4270-b7b7-090b5759ea9d" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-e557755e-9bc3-4270-b7b7-090b5759ea9d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Deleting offline snapshot e557755e-9bc3-4270-b7b7-090b5759ea9d of volume da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] snapshot_file for this snap is: volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76e0358-0fd8-48b0-8df4-e4154f2b0582]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:57 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:57 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:58 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da5ec8be-74d3-45f1-9c76-187be0a80080(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f52a55-29b1-436b-aebe-e12864646db9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:58 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:55:58 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:58 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.444s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:58 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:58 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:59 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.632s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:59 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d Jul 22 01:55:59 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:59 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080.e557755e-9bc3-4270-b7b7-090b5759ea9d" returned: 0 in 0.375s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-e557755e-9bc3-4270-b7b7-090b5759ea9d" released by "_delete_snapshot" :: held 1.967s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.942s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.618s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96922207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab59f44e-846f-474f-b774-b2d3feffdd24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='320a129f686540e7ac7224711a3b487b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:55:53Z,use_quota=True,user_id='542bd21f8a8b49a38f7f9ba8cfdbb6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Creating volume ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:55:59 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba26082-b814-4aba-89d2-aa49d0eb9860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd65354f-c52f-4a0b-bc62-c499bb67b088', 'volume_size': 2, 'source_volid': 'da5ec8be-74d3-45f1-9c76-187be0a80080', 'source_volstatus': 'available'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:59 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 1073741824 Jul 22 01:55:59 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beee7dd3-8a7a-4a15-af6b-05e1441c2c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:55:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Volume volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 (dd65354f-c52f-4a0b-bc62-c499bb67b088): created successfully Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beee7dd3-8a7a-4a15-af6b-05e1441c2c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:55:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Flow 'volume_create_manager' (648c858a-1374-4897-b6ec-c036a00a6734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:55:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-77511307-5f51-4725-8a41-75b0d795d18f tempest-VolumesCloneTest-954559856 None] Created volume successfully. Jul 22 01:56:00 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 1073741824" returned: 0 in 0.628s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:00 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 Jul 22 01:56:00 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:00 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bb0cac-efd6-4a34-995c-a3d349bb010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab59f44e-846f-474f-b774-b2d3feffdd24', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e85fe60-44a5-4d71-b896-44b2482232a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Volume volume-ab59f44e-846f-474f-b774-b2d3feffdd24 (ab59f44e-846f-474f-b774-b2d3feffdd24): created successfully Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e85fe60-44a5-4d71-b896-44b2482232a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Flow 'volume_create_manager' (7fae42bc-6241-4cb2-8fb7-2dedd86bb211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-7d0450eb-166b-4514-829f-8dbad098b2fd req-68a63abf-2814-4272-98f7-a033b5ed6196 tempest-VolumesSnapshotsTestJSON-1947150708 None] Created volume successfully. Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-dd65354f-c52f-4a0b-bc62-c499bb67b088-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "cinder-dd65354f-c52f-4a0b-bc62-c499bb67b088-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53e605-735e-4b1e-80c9-7e442a74e466]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:01 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 Jul 22 01:56:01 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Creating offline snapshot ffd77dd9-7d8f-4a42-8786-68a2eb08b166 of volume ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ffaf4-5bbb-4eb6-a413-d096911249d1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:01 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088" returned: 0 in 0.716s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:02 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088 Jul 22 01:56:02 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:02 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 Jul 22 01:56:02 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:02 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:02 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 1G Jul 22 01:56:02 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:02 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd65354f-c52f-4a0b-bc62-c499bb67b088" returned: 0 in 0.515s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-dd65354f-c52f-4a0b-bc62-c499bb67b088" released by "delete_volume" :: held 1.291s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Created reservations ['c99f0e9a-bb17-4973-bdb5-297e3c8c829e', 'fe6747f2-4b94-4723-81a9-45497a8fbe4e', 'a42a508a-aa3a-469c-9ae5-05e54c799a64', '0ebc954d-d425-4f6b-892b-6a2c98cd4408'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:02 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:02 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:02 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:02 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.304s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 1G" returned: 0 in 0.534s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab59f44e-846f-474f-b774-b2d3feffdd24 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Deleted volume successfully. Jul 22 01:56:03 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab59f44e-846f-474f-b774-b2d3feffdd24 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 Jul 22 01:56:03 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-97d76861-b645-4ad8-9526-75f1de700e22 tempest-VolumesCloneTest-954559856 None] Lock "cinder-dd65354f-c52f-4a0b-bc62-c499bb67b088-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:03 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab59f44e-846f-474f-b774-b2d3feffdd24 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:03 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 is being set with open permissions: ugo+rw Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:03 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 Jul 22 01:56:03 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-da5ec8be-74d3-45f1-9c76-187be0a80080-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "cinder-da5ec8be-74d3-45f1-9c76-187be0a80080-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Acquiring lock "cinder-quobyte-da5ec8be-74d3-45f1-9c76-187be0a80080" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-da5ec8be-74d3-45f1-9c76-187be0a80080" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:03 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166" returned: 0 in 0.400s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d41dd42-7e58-4687-a587-a376f6083954]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:03 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info Jul 22 01:56:03 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:03 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:56:03 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:04 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:04 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info is being set with open permissions: ugo+rw Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:04 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info Jul 22 01:56:04 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:04 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.475s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:04 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080 Jul 22 01:56:04 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:04 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.info" returned: 0 in 0.455s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-c1d76107-4952-4475-9cd3-af49489ae728 req-be77139b-ccc1-47e3-abd0-7b31d746286b tempest-VolumesSnapshotsTestJSON-1947150708 None] Create snapshot completed successfully Jul 22 01:56:04 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da5ec8be-74d3-45f1-9c76-187be0a80080" returned: 0 in 0.597s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "cinder-quobyte-da5ec8be-74d3-45f1-9c76-187be0a80080" released by "delete_volume" :: held 1.178s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Created reservations ['bb568544-b77d-43d3-9b50-e26af01f0d0a', '2a68e1f8-cbdb-48a0-85df-0004fa065a50', '5fc56a97-6203-4b7b-baab-4091910a7d8d', 'e3c74362-bbcb-4835-910c-6d139c278863'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:05 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:05 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:05 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.613s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Deleted volume successfully. Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a7a34dcc-7484-406d-b457-026445f73698 tempest-VolumesCloneTest-954559856 None] Lock "cinder-da5ec8be-74d3-45f1-9c76-187be0a80080-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "cinder-ffd77dd9-7d8f-4a42-8786-68a2eb08b166-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-ffd77dd9-7d8f-4a42-8786-68a2eb08b166-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "cinder-quobyte-ffd77dd9-7d8f-4a42-8786-68a2eb08b166" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ffd77dd9-7d8f-4a42-8786-68a2eb08b166" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Deleting offline snapshot ffd77dd9-7d8f-4a42-8786-68a2eb08b166 of volume ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] snapshot_file for this snap is: volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32aa6b7-db58-4fa8-9db5-1ed8ec4ca0ba]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:06 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 Jul 22 01:56:06 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:06 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166" returned: 0 in 0.676s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab59f44e-846f-474f-b774-b2d3feffdd24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e885049-35d6-4049-810b-7e0ffd761fa8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:06 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 Jul 22 01:56:06 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:07 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24" returned: 0 in 0.575s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:07 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 Jul 22 01:56:07 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:07 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166" returned: 0 in 0.513s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:07 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166 Jul 22 01:56:07 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:08 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24.ffd77dd9-7d8f-4a42-8786-68a2eb08b166" returned: 0 in 0.528s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ffd77dd9-7d8f-4a42-8786-68a2eb08b166" released by "_delete_snapshot" :: held 2.508s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" released by "delete_snapshot" :: held 2.558s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:08 devstack cinder-volume[87153]: WARNING cinder.quota [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:56:08 devstack cinder-volume[87153]: DEBUG cinder.quota [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Created reservations ['1f194da4-5d19-4c68-9112-ed104b2f065b', 'b4c3ebb4-81d1-41d5-aea4-a3c4c1618b6b', '8f9d4ce6-8cf8-47af-bbac-79d7b2064a54', 'ee8fdddd-0c56-48dd-8608-ebac7b84cc0d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Delete snapshot completed successfully. Jul 22 01:56:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-a004f4d7-f7de-4d19-b4a0-ee3849a337ab req-cc4c0df0-5474-40cc-9b7f-1c54ed13421d tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-ffd77dd9-7d8f-4a42-8786-68a2eb08b166-delete_snapshot" released by "delete_snapshot" :: held 2.875s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "cinder-ab59f44e-846f-474f-b774-b2d3feffdd24-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-ab59f44e-846f-474f-b774-b2d3feffdd24-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" acquired by "delete_volume" :: waited 0.041s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[56788676-b246-4b02-9474-2c29aae0f9d1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:10 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 Jul 22 01:56:10 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:10 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24" returned: 0 in 0.929s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:10 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24 Jul 22 01:56:10 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:11 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ab59f44e-846f-474f-b774-b2d3feffdd24" returned: 0 in 0.969s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-quobyte-ab59f44e-846f-474f-b774-b2d3feffdd24" released by "delete_volume" :: held 2.073s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:11 devstack cinder-volume[87153]: DEBUG cinder.quota [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Created reservations ['3cb70462-3cbf-445b-b501-eaa384f9634b', 'c7fa2185-0c09-4710-8f71-42cf52ab61ba', '3a99cbe4-c0b3-4274-917c-20edd87dd371', 'c2c1233a-177a-4462-b0ce-c36a6ac8c907'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:12 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:12 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (1ca18717-c1da-4f25-b1b0-a40a462c5478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6196408-fe77-4330-9a40-b0bd922f4e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6196408-fe77-4330-9a40-b0bd922f4e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2011899231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed869de-d590-41c6-a3c9-5c69e2f34a08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:12Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cde3a0-55eb-4d6d-bc6d-f8a02d939ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cde3a0-55eb-4d6d-bc6d-f8a02d939ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc501a5b-8781-4654-8399-1000aea962e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc501a5b-8781-4654-8399-1000aea962e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed869de-d590-41c6-a3c9-5c69e2f34a08', 'volume_name': 'volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6e9830-8fab-45a4-83aa-2d63ea4540ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6e9830-8fab-45a4-83aa-2d63ea4540ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36ae1e-db6f-4ba3-bb0f-da27d3050b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:12 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Volume 7ed869de-d590-41c6-a3c9-5c69e2f34a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08', 'volume_size': 1} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2011899231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed869de-d590-41c6-a3c9-5c69e2f34a08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:12Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Creating volume 7ed869de-d590-41c6-a3c9-5c69e2f34a08 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:12 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:12 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 1073741824 Jul 22 01:56:12 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:13 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.921s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:13 devstack cinder-volume[87153]: DEBUG cinder.manager [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Deleted volume successfully. Jul 22 01:56:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-f462ca3e-9674-4574-b733-05bd1db65c66 req-8d2b85ac-50c8-45ed-ad41-c7be69df73e0 tempest-VolumesSnapshotsTestJSON-1947150708 None] Lock "cinder-ab59f44e-846f-474f-b774-b2d3feffdd24-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:13 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 1073741824" returned: 0 in 0.769s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:13 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 Jul 22 01:56:13 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:14 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08" returned: 0 in 0.498s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b36ae1e-db6f-4ba3-bb0f-da27d3050b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fca739a-31bb-4d26-9df1-235a3ea6b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:14 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Volume volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 (7ed869de-d590-41c6-a3c9-5c69e2f34a08): created successfully Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fca739a-31bb-4d26-9df1-235a3ea6b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (1ca18717-c1da-4f25-b1b0-a40a462c5478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:14 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-492db7aa-eda9-4c11-9f41-5b4f629d2d65 tempest-VolumesListTestJSON-1181579221 None] Created volume successfully. Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (9f78fe4f-7e8f-483a-961a-705181fcc75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a8b3a-ba07-44cc-94f2-b484e1ead6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58a8b3a-ba07-44cc-94f2-b484e1ead6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779975586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00426eb0-7995-472f-949e-426ef22ed473,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:16Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1108b50e-2fbc-458f-bdf0-946c6ed750c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1108b50e-2fbc-458f-bdf0-946c6ed750c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef77a8c-c779-4e4e-b803-1e18f4b3371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef77a8c-c779-4e4e-b803-1e18f4b3371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00426eb0-7995-472f-949e-426ef22ed473', 'volume_name': 'volume-00426eb0-7995-472f-949e-426ef22ed473', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1a61b0-58aa-43e5-be52-36c91d9f43ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1a61b0-58aa-43e5-be52-36c91d9f43ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de141aaa-1cc2-4bcc-85ce-41cceac8a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Volume 00426eb0-7995-472f-949e-426ef22ed473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00426eb0-7995-472f-949e-426ef22ed473', 'volume_size': 1} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-779975586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00426eb0-7995-472f-949e-426ef22ed473,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:16Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Creating volume 00426eb0-7995-472f-949e-426ef22ed473 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:16 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:16 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 1073741824 Jul 22 01:56:16 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:16 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 1073741824" returned: 0 in 0.541s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:17 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 Jul 22 01:56:17 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:17 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473" returned: 0 in 0.343s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de141aaa-1cc2-4bcc-85ce-41cceac8a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00426eb0-7995-472f-949e-426ef22ed473', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ecd97d-0fa7-44a4-a7bb-80c910db4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Volume volume-00426eb0-7995-472f-949e-426ef22ed473 (00426eb0-7995-472f-949e-426ef22ed473): created successfully Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ecd97d-0fa7-44a4-a7bb-80c910db4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (9f78fe4f-7e8f-483a-961a-705181fcc75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5fea93a2-ada4-4db5-9094-66b3116b3122 tempest-VolumesListTestJSON-1181579221 None] Created volume successfully. Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (cb8eb36c-3c92-4b05-9080-c25da317cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcfe531-ad84-46a5-80b6-bd4459d36d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcfe531-ad84-46a5-80b6-bd4459d36d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-452684996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dcca18-676f-4362-8137-e152374cc9ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:21Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4884ad58-190a-467b-84ec-01a5a263da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4884ad58-190a-467b-84ec-01a5a263da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685830c8-0d3d-48cc-94fa-c5ee3f3c4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685830c8-0d3d-48cc-94fa-c5ee3f3c4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dcca18-676f-4362-8137-e152374cc9ff', 'volume_name': 'volume-57dcca18-676f-4362-8137-e152374cc9ff', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937df069-9f50-41e9-b295-3b00bd8c1861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937df069-9f50-41e9-b295-3b00bd8c1861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5fd4fa-703c-494d-8c69-021a3b008d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:21 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Volume 57dcca18-676f-4362-8137-e152374cc9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dcca18-676f-4362-8137-e152374cc9ff', 'volume_size': 1} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-452684996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dcca18-676f-4362-8137-e152374cc9ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b1a57bc06374704a0671927c476cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:21Z,use_quota=True,user_id='0aecef9cd9434a31983faa6b1c32823d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Creating volume 57dcca18-676f-4362-8137-e152374cc9ff {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:21 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:21 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff 1073741824 Jul 22 01:56:21 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:22 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff 1073741824" returned: 0 in 1.446s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:23 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff Jul 22 01:56:23 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:23 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff" returned: 0 in 0.444s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5fd4fa-703c-494d-8c69-021a3b008d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dcca18-676f-4362-8137-e152374cc9ff', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd040557-68cf-4d7d-8a7d-605dcf15d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Volume volume-57dcca18-676f-4362-8137-e152374cc9ff (57dcca18-676f-4362-8137-e152374cc9ff): created successfully Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd040557-68cf-4d7d-8a7d-605dcf15d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Flow 'volume_create_manager' (cb8eb36c-3c92-4b05-9080-c25da317cadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c1cc171c-2b7c-4c4c-bf5a-772c7b28f591 tempest-VolumesListTestJSON-1181579221 None] Created volume successfully. Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (ae64667d-5e34-48ab-b715-16b5485e3842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758dce1d-b5c9-4971-ad21-ccbe96f8f280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758dce1d-b5c9-4971-ad21-ccbe96f8f280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121622451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4629f8f4-5415-49b3-badb-c03b3f67960a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:24Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e65ba4-2e42-476c-80b9-20c0c9785fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e65ba4-2e42-476c-80b9-20c0c9785fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a2da0-4b17-4260-8850-ef0621037036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a2da0-4b17-4260-8850-ef0621037036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4629f8f4-5415-49b3-badb-c03b3f67960a', 'volume_name': 'volume-4629f8f4-5415-49b3-badb-c03b3f67960a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d9ad6f-82bb-498b-b88e-1f6a2668677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d9ad6f-82bb-498b-b88e-1f6a2668677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b87dc04-003d-4db8-a2c3-94037e5cb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Volume 4629f8f4-5415-49b3-badb-c03b3f67960a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4629f8f4-5415-49b3-badb-c03b3f67960a', 'volume_size': 1} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121622451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4629f8f4-5415-49b3-badb-c03b3f67960a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:24Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Creating volume 4629f8f4-5415-49b3-badb-c03b3f67960a {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:23 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:24 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a 1073741824 Jul 22 01:56:24 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:24 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a 1073741824" returned: 0 in 0.974s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:25 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a Jul 22 01:56:25 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:25 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a" returned: 0 in 0.572s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b87dc04-003d-4db8-a2c3-94037e5cb216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4629f8f4-5415-49b3-badb-c03b3f67960a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c546e4-f169-4d2c-92a4-53fca1a17e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Volume volume-4629f8f4-5415-49b3-badb-c03b3f67960a (4629f8f4-5415-49b3-badb-c03b3f67960a): created successfully Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c546e4-f169-4d2c-92a4-53fca1a17e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (ae64667d-5e34-48ab-b715-16b5485e3842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-13a017e0-5abb-472d-9cef-65a6e454067c tempest-VolumesTestJSON-662124171 None] Created volume successfully. Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (09f01748-d35b-45f1-a552-3bc714fd9d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5914a6d5-e52a-4613-ac88-8778fa5cd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5914a6d5-e52a-4613-ac88-8778fa5cd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576444435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:27Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5116e1c-37ff-442a-b4d0-4e9c3ce75e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5116e1c-37ff-442a-b4d0-4e9c3ce75e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3a1bf3-58ad-4623-b6f9-d81c7ce9526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3a1bf3-58ad-4623-b6f9-d81c7ce9526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00', 'volume_name': 'volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a8de83-945e-4e47-a544-165612a2637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a8de83-945e-4e47-a544-165612a2637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485adc1f-5d7f-4a6b-b6d6-b7b5d949a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Volume e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00', 'volume_size': 1} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576444435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:27Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Creating volume e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:27 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:27 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 1073741824 Jul 22 01:56:27 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:28 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 1073741824" returned: 0 in 1.027s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:29 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 Jul 22 01:56:29 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:29 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" returned: 0 in 0.527s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485adc1f-5d7f-4a6b-b6d6-b7b5d949a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e96c4d7-a666-42d1-bc99-3a16f59376b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:29 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Volume volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 (e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00): created successfully Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e96c4d7-a666-42d1-bc99-3a16f59376b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (09f01748-d35b-45f1-a552-3bc714fd9d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2c6e1706-abad-4fb0-9693-0aaf9359f5fc tempest-VolumesTestJSON-662124171 None] Created volume successfully. Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-57dcca18-676f-4362-8137-e152374cc9ff-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-57dcca18-676f-4362-8137-e152374cc9ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-quobyte-57dcca18-676f-4362-8137-e152374cc9ff" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-57dcca18-676f-4362-8137-e152374cc9ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[850331c8-67df-46f3-a8ba-1cccd20cec6f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:30 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff Jul 22 01:56:30 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:30 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:30 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff Jul 22 01:56:30 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:30 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-57dcca18-676f-4362-8137-e152374cc9ff" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-57dcca18-676f-4362-8137-e152374cc9ff" released by "delete_volume" :: held 0.831s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Created reservations ['2987a425-ba35-4918-9dd2-b887f375ea24', 'c2518d08-d5bb-49e0-b17b-cfa13c0569f4', '6c156d80-7019-4314-a88e-e1349e699d1e', '65741c90-38aa-4d54-81c7-2fb9c4407a8d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:31 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:31 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-00426eb0-7995-472f-949e-426ef22ed473-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-00426eb0-7995-472f-949e-426ef22ed473-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:31 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-quobyte-00426eb0-7995-472f-949e-426ef22ed473" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.433s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Deleted volume successfully. Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-00426eb0-7995-472f-949e-426ef22ed473" acquired by "delete_volume" :: waited 0.054s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a05777-5a4e-4ab0-829b-b1ff509656a8 tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-57dcca18-676f-4362-8137-e152374cc9ff-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6736f61-44cc-43dc-ba1d-5e3bf7751fe3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (ae092917-3704-43cf-ad75-9576b162c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a5182c-41ad-4a1e-940f-39b2871b6d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a5182c-41ad-4a1e-940f-39b2871b6d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-44291668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b19687c-9061-4d67-b751-0a8bb3ac41e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:31Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcea4ae-5203-4ae0-b2ce-05172e6ae17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcea4ae-5203-4ae0-b2ce-05172e6ae17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22febdd-9eba-4836-b824-ec677df56291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22febdd-9eba-4836-b824-ec677df56291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b19687c-9061-4d67-b751-0a8bb3ac41e4', 'volume_name': 'volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6cd7b0-19ab-4e5c-bc18-b2bbde090bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6cd7b0-19ab-4e5c-bc18-b2bbde090bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac31ff2-99dd-4ddd-adce-7eb0502208d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Volume 8b19687c-9061-4d67-b751-0a8bb3ac41e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4', 'volume_size': 1} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-44291668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b19687c-9061-4d67-b751-0a8bb3ac41e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f61ab5102b4fa8a36529234ba65f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:31Z,use_quota=True,user_id='35c16abd77e94c788b86db77ce35430e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Creating volume 8b19687c-9061-4d67-b751-0a8bb3ac41e4 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:31 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:31 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 1073741824 Jul 22 01:56:31 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Flow 'volume_create_manager' (0df40361-389b-4232-8c93-d45aca7af0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae3aad9-97cb-4c07-8adc-21d82f2f9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 Jul 22 01:56:31 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae3aad9-97cb-4c07-8adc-21d82f2f9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-511860149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b887ac83-fe4d-4b2e-a126-0fe338603cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1077d382a54a55ae4a42e67f71ce5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:32Z,use_quota=True,user_id='0375a96712cd46749d50092c5ecbbcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d567b0-4d9e-43ce-a5a0-51fc1ff296ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d567b0-4d9e-43ce-a5a0-51fc1ff296ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c4f458-7862-4c35-84a6-3734848adf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c4f458-7862-4c35-84a6-3734848adf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b887ac83-fe4d-4b2e-a126-0fe338603cbd', 'volume_name': 'volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7cdd7-37c6-4254-9477-b06702b633de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7cdd7-37c6-4254-9477-b06702b633de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ee49f6-6844-469d-92ab-8fa64c01a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:31 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Volume b887ac83-fe4d-4b2e-a126-0fe338603cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd', 'volume_size': 1} Jul 22 01:56:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:32 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473" returned: 0 in 0.498s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:32 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473 Jul 22 01:56:32 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:32 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 1073741824" returned: 0 in 0.451s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:32 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 Jul 22 01:56:32 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:32 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-00426eb0-7995-472f-949e-426ef22ed473" returned: 0 in 0.282s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-00426eb0-7995-472f-949e-426ef22ed473" released by "delete_volume" :: held 0.832s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Created reservations ['c0cdaa6f-3e0c-4752-9b96-e91d3a9ac907', '6f93936b-1533-40ed-b129-bd2595522919', 'ae316269-bb12-4578-8689-83c954f9c14d', 'cd8ceb41-f748-4432-a87b-02df801e39cc'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:32 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4" returned: 0 in 0.288s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-511860149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b887ac83-fe4d-4b2e-a126-0fe338603cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1077d382a54a55ae4a42e67f71ce5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:32Z,use_quota=True,user_id='0375a96712cd46749d50092c5ecbbcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Creating volume b887ac83-fe4d-4b2e-a126-0fe338603cbd {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:32 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac31ff2-99dd-4ddd-adce-7eb0502208d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:32 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd 1073741824 Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c20e23-2faa-4c10-bb8a-ba1d5debef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:32 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:32 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Volume volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 (8b19687c-9061-4d67-b751-0a8bb3ac41e4): created successfully Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c20e23-2faa-4c10-bb8a-ba1d5debef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Flow 'volume_create_manager' (ae092917-3704-43cf-ad75-9576b162c75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0361dd02-e3ff-41d6-ba4a-ac9bb4a8e76c tempest-VolumesTestJSON-662124171 None] Created volume successfully. Jul 22 01:56:32 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:32 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-7ed869de-d590-41c6-a3c9-5c69e2f34a08-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-7ed869de-d590-41c6-a3c9-5c69e2f34a08-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "cinder-quobyte-7ed869de-d590-41c6-a3c9-5c69e2f34a08" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-7ed869de-d590-41c6-a3c9-5c69e2f34a08" acquired by "delete_volume" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[429289ad-5f76-4cf5-8c0f-1d1cb94ad03d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:32 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.401s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:32 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:32 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 Jul 22 01:56:32 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Deleted volume successfully. Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d49cf8c7-6192-4e31-bb91-64bac9fc048a tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-00426eb0-7995-472f-949e-426ef22ed473-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:33 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd 1073741824" returned: 0 in 0.602s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:33 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd Jul 22 01:56:33 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:33 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08" returned: 0 in 0.434s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:33 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08 Jul 22 01:56:33 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:33 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd" returned: 0 in 0.390s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ee49f6-6844-469d-92ab-8fa64c01a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544f16db-2d1d-48b1-9b31-3170230b15b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:33 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Volume volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd (b887ac83-fe4d-4b2e-a126-0fe338603cbd): created successfully Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544f16db-2d1d-48b1-9b31-3170230b15b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Flow 'volume_create_manager' (0df40361-389b-4232-8c93-d45aca7af0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a3cd6855-b07b-43b6-a5d0-31dfa7faea25 tempest-ServersNegativeTestJSON-576310127 None] Created volume successfully. Jul 22 01:56:33 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7ed869de-d590-41c6-a3c9-5c69e2f34a08" returned: 0 in 0.340s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-quobyte-7ed869de-d590-41c6-a3c9-5c69e2f34a08" released by "delete_volume" :: held 0.821s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Created reservations ['43596406-0bd2-40cb-8797-ffb702125e3c', 'c6f7f045-ae11-4433-b634-dd2f081160a7', 'e170c9f6-a072-43bf-80e6-2256475cd9ec', '3cc3cf81-079a-4c0e-b688-663e6a3badd9'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:33 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:33 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:34 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.345s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Deleted volume successfully. Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4ca081d-29ff-4317-80de-bf42d347419e tempest-VolumesListTestJSON-1181579221 None] Lock "cinder-7ed869de-d590-41c6-a3c9-5c69e2f34a08-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-8b19687c-9061-4d67-b751-0a8bb3ac41e4-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "cinder-8b19687c-9061-4d67-b751-0a8bb3ac41e4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-quobyte-8b19687c-9061-4d67-b751-0a8bb3ac41e4" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-8b19687c-9061-4d67-b751-0a8bb3ac41e4" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a63db03-614e-4b97-88b8-695d0a73b871]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:34 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 Jul 22 01:56:34 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:35 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4" returned: 0 in 0.485s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:35 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4 Jul 22 01:56:35 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:35 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8b19687c-9061-4d67-b751-0a8bb3ac41e4" returned: 0 in 0.325s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-8b19687c-9061-4d67-b751-0a8bb3ac41e4" released by "delete_volume" :: held 0.875s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Created reservations ['9d55a52c-ba79-44a1-8b7e-61ab10e39760', 'e4159bd1-8232-4d28-ae24-0d3143eec297', '0ada31a9-2458-4bd3-b32d-c777b3a2e883', '351334a1-304b-4e8d-ba01-af1377bd3666'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:35 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:35 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Flow 'volume_create_manager' (99143ac4-1822-44af-a03a-b1178da725f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f644e5-b38a-4e7e-b354-e8ebc638b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f644e5-b38a-4e7e-b354-e8ebc638b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1872237092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865daae-676c-4bd2-ba58-e96589849588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1077d382a54a55ae4a42e67f71ce5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:36Z,use_quota=True,user_id='0375a96712cd46749d50092c5ecbbcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e8493d-c66a-4dc2-8553-a09732394ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e8493d-c66a-4dc2-8553-a09732394ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc645e-28d8-4b3a-aeee-aa2a76487d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcc645e-28d8-4b3a-aeee-aa2a76487d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2865daae-676c-4bd2-ba58-e96589849588', 'volume_name': 'volume-2865daae-676c-4bd2-ba58-e96589849588', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8df9ff-be6f-4724-9acb-e6dc2d336d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8df9ff-be6f-4724-9acb-e6dc2d336d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c342ae-8cde-4f09-973e-1222b0cf5da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:35 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Volume 2865daae-676c-4bd2-ba58-e96589849588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2865daae-676c-4bd2-ba58-e96589849588', 'volume_size': 1} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1872237092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2865daae-676c-4bd2-ba58-e96589849588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab1077d382a54a55ae4a42e67f71ce5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:36Z,use_quota=True,user_id='0375a96712cd46749d50092c5ecbbcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Creating volume 2865daae-676c-4bd2-ba58-e96589849588 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:35 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "cinder-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:36 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 1073741824 Jul 22 01:56:36 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-quobyte-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fbe0d-9f46-49fe-bd74-cde4ada3cf32]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:36 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Deleted volume successfully. Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-34869dbe-3355-44d4-bf93-9551f04d3f3e tempest-VolumesTestJSON-662124171 None] Lock "cinder-8b19687c-9061-4d67-b751-0a8bb3ac41e4-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:36 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 Jul 22 01:56:36 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:36 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 1073741824" returned: 0 in 0.511s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=108,cinder:SELECT=74,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:36 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" returned: 0 in 0.438s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:36 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 Jul 22 01:56:36 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:36 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00 Jul 22 01:56:36 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:36 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=76,cinder:INSERT=24,cinder:UPDATE=102,cinder:DELETE=11 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c342ae-8cde-4f09-973e-1222b0cf5da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2865daae-676c-4bd2-ba58-e96589849588', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5e7fc4-cedd-445f-b431-c49d6cf933f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Volume volume-2865daae-676c-4bd2-ba58-e96589849588 (2865daae-676c-4bd2-ba58-e96589849588): created successfully Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5e7fc4-cedd-445f-b431-c49d6cf933f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Flow 'volume_create_manager' (99143ac4-1822-44af-a03a-b1178da725f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ded6a7f7-9f33-4cdf-8de6-299d99ae8ba4 tempest-ServersNegativeTestJSON-576310127 None] Created volume successfully. Jul 22 01:56:36 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00" released by "delete_volume" :: held 0.813s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Created reservations ['bbae0348-c3a9-4b00-a9e3-4596bccec771', 'ec9b6905-f3fc-47d9-a9fb-b6e63d1f24f5', '58e061db-befa-4abf-9edd-ec1e13ee3757', '078b192c-6a6a-4a61-b19a-ecd72e326c68'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:37 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:37 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-4629f8f4-5415-49b3-badb-c03b3f67960a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "cinder-4629f8f4-5415-49b3-badb-c03b3f67960a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Acquiring lock "cinder-quobyte-4629f8f4-5415-49b3-badb-c03b3f67960a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-4629f8f4-5415-49b3-badb-c03b3f67960a" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aadd7d0-7438-4559-8586-56df0b271469]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:37 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.286s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:37 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Deleted volume successfully. Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a9fb70c5-b915-41fd-831d-ffdd2358d02d tempest-VolumesTestJSON-662124171 None] Lock "cinder-e0ddf5cd-ad8a-4282-9422-0f9be3a9bc00-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:37 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a Jul 22 01:56:37 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:37 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a" returned: 0 in 0.412s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:37 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a Jul 22 01:56:37 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Flow 'volume_create_manager' (3a261cc8-3080-4cfb-8753-01f7d4672f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19e13a-d37c-404d-8d84-ef2b9ebfa9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19e13a-d37c-404d-8d84-ef2b9ebfa9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1796678584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef832f9c-9fd7-4714-aab1-93205b80a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fb68cac1c74125a9038ced914af3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:38Z,use_quota=True,user_id='ccf2e88bfe024745b849de915336bdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9dcb7d-1868-4ea5-b6e5-288e4bd92dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9dcb7d-1868-4ea5-b6e5-288e4bd92dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6a8919-9bcf-4269-8b48-6b14a275def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6a8919-9bcf-4269-8b48-6b14a275def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef832f9c-9fd7-4714-aab1-93205b80a8ca', 'volume_name': 'volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571571ff-6d6c-46f3-821d-994983891082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571571ff-6d6c-46f3-821d-994983891082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b3a80c-c6dd-4cb6-9018-fc8086ce506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Volume ef832f9c-9fd7-4714-aab1-93205b80a8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca', 'volume_size': 1} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1796678584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef832f9c-9fd7-4714-aab1-93205b80a8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2fb68cac1c74125a9038ced914af3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:38Z,use_quota=True,user_id='ccf2e88bfe024745b849de915336bdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Creating volume ef832f9c-9fd7-4714-aab1-93205b80a8ca {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:37 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:37 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca 1073741824 Jul 22 01:56:37 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:37 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4629f8f4-5415-49b3-badb-c03b3f67960a" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "cinder-quobyte-4629f8f4-5415-49b3-badb-c03b3f67960a" released by "delete_volume" :: held 0.730s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:37 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Created reservations ['680dd994-6d79-47d4-ab2e-87c67fcb4700', '7e84a5bd-7516-49f2-b46c-6bae9da25a73', '68bfd12a-25a7-45fa-8587-9c1827164f8b', '7699b298-1668-4b4f-9532-c89ecefb1023'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:38 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:38 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:38 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca 1073741824" returned: 0 in 0.555s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "cinder-2865daae-676c-4bd2-ba58-e96589849588-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:38 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Deleted volume successfully. Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-2865daae-676c-4bd2-ba58-e96589849588-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b4f5e1e-8d6c-4930-9848-b6fa0798bae4 tempest-VolumesTestJSON-662124171 None] Lock "cinder-4629f8f4-5415-49b3-badb-c03b3f67960a-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:38 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca Jul 22 01:56:38 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "cinder-quobyte-2865daae-676c-4bd2-ba58-e96589849588" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-quobyte-2865daae-676c-4bd2-ba58-e96589849588" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a0b91-38fb-4105-9dac-203f8437e6fe]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:38 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 Jul 22 01:56:38 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:38 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca" returned: 0 in 0.309s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b3a80c-c6dd-4cb6-9018-fc8086ce506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ed94fe-6ef7-4d79-ba60-7ae4d69dada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:38 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Volume volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca (ef832f9c-9fd7-4714-aab1-93205b80a8ca): created successfully Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ed94fe-6ef7-4d79-ba60-7ae4d69dada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Flow 'volume_create_manager' (3a261cc8-3080-4cfb-8753-01f7d4672f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-41b2cd8a-0c14-4fb5-9cce-3d28aea87ec1 tempest-VolumesNegativeTest-1559896998 None] Created volume successfully. Jul 22 01:56:38 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:39 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588 Jul 22 01:56:39 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:39 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2865daae-676c-4bd2-ba58-e96589849588" returned: 0 in 0.267s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-quobyte-2865daae-676c-4bd2-ba58-e96589849588" released by "delete_volume" :: held 0.730s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Created reservations ['cbc83015-3a4b-488b-b192-26bba0a17bb7', '25c07586-4f7c-4a8f-aedb-b8494173572c', 'b2fce38a-a3ca-4969-979c-e69ef93bfd0a', '55ea2046-9c6a-4c0b-8667-18208c11197c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:39 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:39 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "cinder-b887ac83-fe4d-4b2e-a126-0fe338603cbd-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-b887ac83-fe4d-4b2e-a126-0fe338603cbd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "cinder-quobyte-b887ac83-fe4d-4b2e-a126-0fe338603cbd" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-quobyte-b887ac83-fe4d-4b2e-a126-0fe338603cbd" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab8c26-7789-44de-8246-1a2e6e500e8d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:39 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.327s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Deleted volume successfully. Jul 22 01:56:39 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd Jul 22 01:56:39 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-5a9ec139-ede2-4249-af5b-9d53f9dca182 tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-2865daae-676c-4bd2-ba58-e96589849588-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:40 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd" returned: 0 in 0.462s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:40 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd Jul 22 01:56:40 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:40 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b887ac83-fe4d-4b2e-a126-0fe338603cbd" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-quobyte-b887ac83-fe4d-4b2e-a126-0fe338603cbd" released by "delete_volume" :: held 0.782s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Created reservations ['9cf8dca8-8fcf-4043-9248-95aa40578484', '392bfdac-0365-4374-a73c-d737c3c7bc8a', '865fcf09-74c9-4abc-878a-251caa000de0', 'c3e67aa2-79f7-4a94-9c63-fbfb3eaddf00'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:40 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:40 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:40 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Deleted volume successfully. Jul 22 01:56:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d23e96f3-3cd2-4a1e-9c6a-91a4887eff8f tempest-ServersNegativeTestJSON-576310127 None] Lock "cinder-b887ac83-fe4d-4b2e-a126-0fe338603cbd-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (ea75b4be-e001-4866-8bd4-e3272ecbba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c694e2a-e8a0-4482-9cd2-8637bb4f7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c694e2a-e8a0-4482-9cd2-8637bb4f7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-297273560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6c931f-18a9-43fb-a370-1c2b94d70cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:46Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0382d8-ab3f-476f-b479-c3945c1334a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0382d8-ab3f-476f-b479-c3945c1334a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeccdaf8-5523-4adb-aa41-8b26ea788e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeccdaf8-5523-4adb-aa41-8b26ea788e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6c931f-18a9-43fb-a370-1c2b94d70cfa', 'volume_name': 'volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a81c4a7-7c09-49c4-b7df-4c5733e0da9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a81c4a7-7c09-49c4-b7df-4c5733e0da9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b06868a-3f1e-4551-93b7-8f31037cd50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Volume 9d6c931f-18a9-43fb-a370-1c2b94d70cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa', 'volume_size': 1} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-297273560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6c931f-18a9-43fb-a370-1c2b94d70cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:46Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Creating volume 9d6c931f-18a9-43fb-a370-1c2b94d70cfa {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:45 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa 1073741824 Jul 22 01:56:45 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:46 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa 1073741824" returned: 0 in 0.595s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:46 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa Jul 22 01:56:46 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:46 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" returned: 0 in 0.345s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b06868a-3f1e-4551-93b7-8f31037cd50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d95b782-72a9-49b8-ac77-5eecaf5a74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Volume volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa (9d6c931f-18a9-43fb-a370-1c2b94d70cfa): created successfully Jul 22 01:56:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d95b782-72a9-49b8-ac77-5eecaf5a74f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (ea75b4be-e001-4866-8bd4-e3272ecbba3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8027d1e3-d6b0-4445-babf-31dc0d14b5cf tempest-AttachVolumeTestJSON-341495569 None] Created volume successfully. Jul 22 01:56:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-b33c6b03-f05d-4ad3-90be-ea515aa0ccbe req-e586b7ba-0066-4326-8299-9167a4a0e64e tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-b33c6b03-f05d-4ad3-90be-ea515aa0ccbe req-e586b7ba-0066-4326-8299-9167a4a0e64e tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-b33c6b03-f05d-4ad3-90be-ea515aa0ccbe req-e586b7ba-0066-4326-8299-9167a4a0e64e tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-b33c6b03-f05d-4ad3-90be-ea515aa0ccbe req-e586b7ba-0066-4326-8299-9167a4a0e64e tempest-AttachVolumeTestJSON-341495569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca7eb6ee-dd36-494a-8185-dd8bb8f53773', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:56:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-b33c6b03-f05d-4ad3-90be-ea515aa0ccbe req-e586b7ba-0066-4326-8299-9167a4a0e64e tempest-AttachVolumeTestJSON-341495569 None] attachment_update completed successfully. Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:52 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:56:52 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:53 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.642s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (2d2c8927-c215-46ff-ba98-890b65b0d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b5d96e-8ab7-4c52-b46e-fb239fb0d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b5d96e-8ab7-4c52-b46e-fb239fb0d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1793183263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c11fb92-c12c-4db9-a1ef-d71e5360e5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:54Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb52836c-c26a-4465-bd09-ebeda2092c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb52836c-c26a-4465-bd09-ebeda2092c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdcde79-7350-4252-8fc3-9307b98b8da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdcde79-7350-4252-8fc3-9307b98b8da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c11fb92-c12c-4db9-a1ef-d71e5360e5fc', 'volume_name': 'volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3075a3e-86c3-4a1d-befe-fd77239a8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3075a3e-86c3-4a1d-befe-fd77239a8d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e7d44c-fc7d-47bc-9247-8e2c8e1d410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Volume 7c11fb92-c12c-4db9-a1ef-d71e5360e5fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc', 'volume_size': 1} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1793183263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c11fb92-c12c-4db9-a1ef-d71e5360e5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b33a84404949bc965ea2e392f1cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:54Z,use_quota=True,user_id='1c99ec61cb5148469e81fb918c69bed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Creating volume 7c11fb92-c12c-4db9-a1ef-d71e5360e5fc {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:54 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:54 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc 1073741824 Jul 22 01:56:54 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc 1073741824" returned: 0 in 0.730s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:54 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:54 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc Jul 22 01:56:54 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:55 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e7d44c-fc7d-47bc-9247-8e2c8e1d410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c76b4f9-baa7-48c6-ab2e-f9f73884f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Volume volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc (7c11fb92-c12c-4db9-a1ef-d71e5360e5fc): created successfully Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c76b4f9-baa7-48c6-ab2e-f9f73884f398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Flow 'volume_create_manager' (2d2c8927-c215-46ff-ba98-890b65b0d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b5a47312-9d22-4a05-917d-9ce6f03abb6f tempest-AttachVolumeTestJSON-341495569 None] Created volume successfully. Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Flow 'volume_create_manager' (3f6740a9-5c62-4923-b511-44bd84a216cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b26d8d-1b0f-470c-88f9-124d22a2c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b26d8d-1b0f-470c-88f9-124d22a2c924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-648432298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587352c-b03d-41fa-ac1f-0ab0ba1dad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f53ab3c22e4a53a17e134105e409a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:56Z,use_quota=True,user_id='e03233d1a47c46edbcd1d24013f44da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65af6df2-af92-4c0e-b17b-615d2c7f1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65af6df2-af92-4c0e-b17b-615d2c7f1123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51ed1b6-50fc-43e5-80b4-bf51c40207ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51ed1b6-50fc-43e5-80b4-bf51c40207ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6587352c-b03d-41fa-ac1f-0ab0ba1dad15', 'volume_name': 'volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e76dee-37ca-46b2-9a52-2d354f80ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e76dee-37ca-46b2-9a52-2d354f80ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38894466-baad-4a24-9c0e-3555b96a3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:55 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15', 'volume_size': 1} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-648432298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587352c-b03d-41fa-ac1f-0ab0ba1dad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f53ab3c22e4a53a17e134105e409a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:56:56Z,use_quota=True,user_id='e03233d1a47c46edbcd1d24013f44da7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Creating volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:56:55 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:56:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:55 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 1073741824 Jul 22 01:56:55 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-69d08000-e4d6-4ce3-8e88-e1ec59c39730 tempest-BackendsCapabilitiesAdminTestsJSON-863995118 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6981163024902, 'free_capacity_gb': 1775.6981163024902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87153) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78f6c9bc-9869-4a74-b77f-86cac7b8e35a tempest-BackendsCapabilitiesAdminTestsJSON-863995118 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6981163024902, 'free_capacity_gb': 1775.6981163024902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87153) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 01:56:56 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 1073741824" returned: 0 in 0.684s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:56 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 Jul 22 01:56:56 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:56 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" returned: 0 in 0.421s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38894466-baad-4a24-9c0e-3555b96a3647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4da2c6a-46a4-4835-9a59-0d131cb526e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:56:56 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Volume volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 (6587352c-b03d-41fa-ac1f-0ab0ba1dad15): created successfully Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4da2c6a-46a4-4835-9a59-0d131cb526e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Flow 'volume_create_manager' (3f6740a9-5c62-4923-b511-44bd84a216cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:56:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a87cb210-e7d1-496b-aea9-10d12b4e5fe7 tempest-SnapshotsActionsTest-885585472 None] Created volume successfully. Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-eda5bd65-8641-496a-ac73-8d6932319607 req-2030fa3a-ee5d-4671-aabd-160e7e0b9313 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-eda5bd65-8641-496a-ac73-8d6932319607 req-2030fa3a-ee5d-4671-aabd-160e7e0b9313 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-eda5bd65-8641-496a-ac73-8d6932319607 req-2030fa3a-ee5d-4671-aabd-160e7e0b9313 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:56:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-eda5bd65-8641-496a-ac73-8d6932319607 req-2030fa3a-ee5d-4671-aabd-160e7e0b9313 tempest-AttachVolumeTestJSON-341495569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '272f152f-f6ce-4c3b-817d-4e4b04f2058f', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:56:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-eda5bd65-8641-496a-ac73-8d6932319607 req-2030fa3a-ee5d-4671-aabd-160e7e0b9313 tempest-AttachVolumeTestJSON-341495569 None] attachment_update completed successfully. Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Creating offline snapshot 0977cace-7160-41c8-a3da-eb9650ea200a of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da4f0aa-6678-4fa0-a5e6-54cfa33968c9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:58 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 Jul 22 01:56:58 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:58 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" returned: 0 in 0.539s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:58 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a 1G Jul 22 01:56:58 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-193ce982-9577-4d36-88d4-f54ce7a100f1 req-a1da2497-0efa-4df6-884c-28cbf59a3d6c tempest-AttachVolumeTestJSON-341495569 None] Terminate volume connection completed successfully. Jul 22 01:56:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-193ce982-9577-4d36-88d4-f54ce7a100f1 req-a1da2497-0efa-4df6-884c-28cbf59a3d6c tempest-AttachVolumeTestJSON-341495569 None] Deleting attachment ca7eb6ee-dd36-494a-8185-dd8bb8f53773. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:56:59 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a 1G" returned: 0 in 0.751s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:59 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:56:59 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:56:59 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 22 01:56:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:56:59 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a is being set with open permissions: ugo+rw Jul 22 01:56:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:56:59 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:56:59 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:00 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.331s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:00 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info Jul 22 01:57:00 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:00 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info is being set with open permissions: ugo+rw Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:00 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info Jul 22 01:57:00 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-52f0c2c9-b888-4fae-ad17-21e63c130e70 req-34fafed0-69ea-4da3-9f12-8a4e42840f4b tempest-AttachVolumeTestJSON-341495569 None] Terminate volume connection completed successfully. Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-52f0c2c9-b888-4fae-ad17-21e63c130e70 req-34fafed0-69ea-4da3-9f12-8a4e42840f4b tempest-AttachVolumeTestJSON-341495569 None] Deleting attachment 272f152f-f6ce-4c3b-817d-4e4b04f2058f. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:57:00 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.info" returned: 0 in 0.342s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5c3a230c-8c40-4351-8bd7-2601ff6c3307 tempest-SnapshotsActionsTest-885585472 None] Create snapshot completed successfully Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Creating offline snapshot 13aed43c-645e-45e4-8730-d229e847c561 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978f71e-480b-4ad0-82bf-a4ed4f6b4cb1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:02 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:02 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:02 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.744s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:02 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 1G Jul 22 01:57:02 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0dbf0fef-b038-487b-bdfe-754d73b96cd5 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-1450838959: creating Jul 22 01:57:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0dbf0fef-b038-487b-bdfe-754d73b96cd5 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-1450838959: created successfully Jul 22 01:57:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0dbf0fef-b038-487b-bdfe-754d73b96cd5 tempest-GroupSnapshotsTest-325374833 None] Create group completed successfully. Jul 22 01:57:03 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 1G" returned: 0 in 0.638s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:03 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 Jul 22 01:57:03 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:03 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561" returned: 0 in 0.372s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:03 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 is being set with open permissions: ugo+rw Jul 22 01:57:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:03 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 Jul 22 01:57:03 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:04 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fea10b0b-f4d1-42cd-ab6b-1ad91be3e613 tempest-SnapshotsActionsTest-885585472 None] Create snapshot completed successfully Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (f5833b09-e33f-4f4b-adb9-abf9381d556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e408cc0b-dca9-4763-ac1f-78d0e35a386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e408cc0b-dca9-4763-ac1f-78d0e35a386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-603480478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3e15c-559a-46be-97c1-8a26d9b161ea,host='devstack@QuobyteHD#QuobyteHD',id=9b0f5ae5-820e-4838-a4ec-8caec2893cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:05Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87e9f87-1bb4-42a8-aa1d-df9c783d0d25),volume_type_id=e87e9f87-1bb4-42a8-aa1d-df9c783d0d25)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5db0f-d9c7-4aa9-9dd7-8915a84d2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5db0f-d9c7-4aa9-9dd7-8915a84d2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c000f8a8-3c7e-45c6-9253-4f910d6ac05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c000f8a8-3c7e-45c6-9253-4f910d6ac05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0f5ae5-820e-4838-a4ec-8caec2893cb4', 'volume_name': 'volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa37e9df-a678-4b86-9be0-70ee6de9b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa37e9df-a678-4b86-9be0-70ee6de9b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b1184e-415f-42eb-b38d-6bcd168dbf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:05 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Volume 9b0f5ae5-820e-4838-a4ec-8caec2893cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4', 'volume_size': 1} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95d3e15c-559a-46be-97c1-8a26d9b161ea,created_at=2026-07-21T23:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-603480478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95d3e15c-559a-46be-97c1-8a26d9b161ea,host='devstack@QuobyteHD#QuobyteHD',id=9b0f5ae5-820e-4838-a4ec-8caec2893cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:05Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87e9f87-1bb4-42a8-aa1d-df9c783d0d25),volume_type_id=e87e9f87-1bb4-42a8-aa1d-df9c783d0d25)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Creating volume 9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:57:05 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:05 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 1073741824 Jul 22 01:57:05 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-13aed43c-645e-45e4-8730-d229e847c561-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-13aed43c-645e-45e4-8730-d229e847c561-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-13aed43c-645e-45e4-8730-d229e847c561" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-13aed43c-645e-45e4-8730-d229e847c561" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Deleting offline snapshot 13aed43c-645e-45e4-8730-d229e847c561 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] snapshot_file for this snap is: volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0a0a7-3107-4d47-ba4c-0f038f961ac4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:05 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 1073741824" returned: 0 in 0.637s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:05 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 Jul 22 01:57:05 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:05 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:05 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Acquiring lock "cinder-ef832f9c-9fd7-4714-aab1-93205b80a8ca-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "cinder-ef832f9c-9fd7-4714-aab1-93205b80a8ca-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Acquiring lock "cinder-quobyte-ef832f9c-9fd7-4714-aab1-93205b80a8ca" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "cinder-quobyte-ef832f9c-9fd7-4714-aab1-93205b80a8ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:06 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561" returned: 0 in 0.601s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.387s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2cad5d-7e2c-4e7c-9755-f649b5507a94]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e490a-86b0-4436-9f45-3b09e885ff82]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b1184e-415f-42eb-b38d-6bcd168dbf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4065abba-e20a-4648-9594-0f7558ea2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Volume volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 (9b0f5ae5-820e-4838-a4ec-8caec2893cb4): created successfully Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4065abba-e20a-4648-9594-0f7558ea2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (f5833b09-e33f-4f4b-adb9-abf9381d556d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2644e824-c64d-491e-817d-7f24dc795c1d tempest-GroupSnapshotsTest-325374833 None] Created volume successfully. Jul 22 01:57:06 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:06 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:06 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca Jul 22 01:57:06 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-quobyte-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032d74a-851d-4905-83fa-83da04a90cb8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.418s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca" returned: 0 in 0.451s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 Jul 22 01:57:06 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:06 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca Jul 22 01:57:06 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:06 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc Jul 22 01:57:06 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:06 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ef832f9c-9fd7-4714-aab1-93205b80a8ca" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "cinder-quobyte-ef832f9c-9fd7-4714-aab1-93205b80a8ca" released by "delete_volume" :: held 0.813s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:06 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Created reservations ['f6fcdab7-653f-4647-bff8-8daccd25f02e', '653c144f-a321-416a-8c1c-b1befd919d52', 'f14643a7-1152-464d-bdb2-655905683ac4', 'b4c4acb0-1a1b-4466-8f2e-1bc68c08d0e6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:06 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc Jul 22 01:57:07 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:07 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561 Jul 22 01:57:07 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:07 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:07 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" returned: 0 in 0.316s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc" released by "delete_volume" :: held 0.771s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:07 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.13aed43c-645e-45e4-8730-d229e847c561" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-13aed43c-645e-45e4-8730-d229e847c561" released by "_delete_snapshot" :: held 1.900s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_snapshot" :: held 1.946s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:07 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.327s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Deleted volume successfully. Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Created reservations ['3b068b17-a0ce-4f85-8e97-0f9179dffd29', 'fbc59a3d-5acb-4c17-af76-77cb1957a2e7', '69822fd7-d637-4e82-991e-fe4e7e984039', '6dbdb797-3ae7-4aaf-b5ad-3e6334198816'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-61f1becb-6bd7-4745-9565-f390cd2db1e5 tempest-VolumesNegativeTest-1559896998 None] Lock "cinder-ef832f9c-9fd7-4714-aab1-93205b80a8ca-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Created reservations ['854e9936-0635-4a89-8073-f18a90b5f4fc', 'e788ce5b-121a-4b1e-8f83-bc4154821574', '03ff3cfc-7e00-4165-aa0a-40d885404873', '79911a95-4ac9-4bc3-a611-1f2adf30e5b6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:07 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:07 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-9d6c931f-18a9-43fb-a370-1c2b94d70cfa-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Delete snapshot completed successfully. Jul 22 01:57:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] GroupSnapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: creating. Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6b441d3d-579e-4e69-87a8-506915822ee0 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-13aed43c-645e-45e4-8730-d229e847c561-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-9d6c931f-18a9-43fb-a370-1c2b94d70cfa-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Group snapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: creating. {{(pid=87153) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-quobyte-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Creating offline snapshot cde2c792-9062-4a94-9a36-f7c87e9da6ab of volume 9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935a761-d69f-4456-a91c-be617d460e1d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eff26b-12e7-4300-8ae7-586926a27910]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:07 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:07 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa Jul 22 01:57:07 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:07 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:07 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Deleted volume successfully. Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b5b9da54-8a54-4e67-86f6-f372b05f3680 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-7c11fb92-c12c-4db9-a1ef-d71e5360e5fc-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:08 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:08 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.446s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:08 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa Jul 22 01:57:08 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:08 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab 1G Jul 22 01:57:08 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:08 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-9d6c931f-18a9-43fb-a370-1c2b94d70cfa" released by "delete_volume" :: held 0.762s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Created reservations ['308926a2-e264-4ffd-a344-9f1f279d0c97', 'a1ce1fe2-0c86-42d9-933a-ebdf5858a7aa', '93aca819-c58b-44b6-b160-6fea81964435', '5cf2cf94-1217-4ee8-82cc-c5b4d96ab625'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:08 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:08 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:08 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab 1G" returned: 0 in 0.577s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:08 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:08 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-f0f4a415-4b53-4139-ab00-59673694df8f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-f0f4a415-4b53-4139-ab00-59673694df8f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:09 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.461s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "cinder-quobyte-f0f4a415-4b53-4139-ab00-59673694df8f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Deleted volume successfully. Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-f0f4a415-4b53-4139-ab00-59673694df8f" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7829f5c7-9d24-4a69-a481-970b3fd3e2d7 tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-9d6c931f-18a9-43fb-a370-1c2b94d70cfa-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf79fb-4fbc-4881-a2b2-5bcb035b8bc6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:09 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.437s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:09 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:09 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:09 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:09 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f Jul 22 01:57:09 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:09 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.273s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:09 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info Jul 22 01:57:09 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:09 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:09 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f Jul 22 01:57:09 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:09 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:09 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:09 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info Jul 22 01:57:09 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:10 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f0f4a415-4b53-4139-ab00-59673694df8f" returned: 0 in 0.317s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-quobyte-f0f4a415-4b53-4139-ab00-59673694df8f" released by "delete_volume" :: held 0.838s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Created reservations ['32cb6b8e-6595-4347-9ab5-84fbbcc2f1d1', '9fb7d873-12df-4a43-9e5a-238b0e6994aa', 'cd38c2fa-a1ca-47e6-886a-d27c89d9a3d5', '7e48455a-b622-482d-8848-17d0e2f86b7f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:10 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:10 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:10 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.info" returned: 0 in 0.330s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.254s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Creating offline snapshot 319482ff-960e-4b1f-a44e-82d643a82c81 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04214b-3b62-4804-8e48-df03d32f5b50]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bb295d96-6fc6-4fe2-8110-b26e97ca8302 tempest-GroupSnapshotsTest-325374833 None] group_snapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: created successfully Jul 22 01:57:10 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.327s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Deleted volume successfully. Jul 22 01:57:10 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:10 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee68b06c-1a0e-42b8-8892-318cb379333a tempest-AttachVolumeTestJSON-341495569 None] Lock "cinder-f0f4a415-4b53-4139-ab00-59673694df8f-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:10 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.458s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:10 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 1G Jul 22 01:57:10 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:11 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 1G" returned: 0 in 0.650s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:11 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 Jul 22 01:57:11 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:11 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81" returned: 0 in 0.480s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:11 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 is being set with open permissions: ugo+rw Jul 22 01:57:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:12 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 Jul 22 01:57:12 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:12 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.189s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Creating volume c5cdcb31-786e-4af3-bc6b-7ff44dde11fc from snapshot cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4b3212cc-8170-4c27-9590-90fdabaa2f5f tempest-SnapshotsActionsTest-885585472 None] Create snapshot completed successfully Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] snapshot: cde2c792-9062-4a94-9a36-f7c87e9da6ab, volume: c5cdcb31-786e-4af3-bc6b-7ff44dde11fc, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f9f828-b13c-4d31-9ffe-89c89460b6de]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:12 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:12 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:12 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d834433c-0c51-4e2b-8a25-1b87149921f2]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:13 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:13 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:13 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-319482ff-960e-4b1f-a44e-82d643a82c81-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-319482ff-960e-4b1f-a44e-82d643a82c81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:13 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc Jul 22 01:57:13 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-319482ff-960e-4b1f-a44e-82d643a82c81" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-319482ff-960e-4b1f-a44e-82d643a82c81" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Deleting offline snapshot 319482ff-960e-4b1f-a44e-82d643a82c81 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] snapshot_file for this snap is: volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21f1d03-35fe-47e7-b4aa-571e2ec40605]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:13 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 Jul 22 01:57:13 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:14 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81" returned: 0 in 0.661s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf63af1-1a9a-4d2d-9a7b-50072f6e7885]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:14 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:14 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:15 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.788s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:15 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 Jul 22 01:57:15 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:16 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81" returned: 0 in 1.133s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:16 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81 Jul 22 01:57:16 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:17 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.319482ff-960e-4b1f-a44e-82d643a82c81" returned: 0 in 0.919s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-319482ff-960e-4b1f-a44e-82d643a82c81" released by "_delete_snapshot" :: held 3.759s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_snapshot" :: held 3.802s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:17 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Created reservations ['9f45a47c-1470-4715-9f67-7da00133d338', '2da79e50-8704-4b6d-b4d8-433d4f745271', 'ce1a362e-0a22-41db-bcd5-0bb9441e60d4', '0aad1c4f-8c0a-4c0c-bae5-eb3e19ec0410'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Delete snapshot completed successfully. Jul 22 01:57:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d9d26096-01ea-4586-a08f-95f2f0f77db1 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-319482ff-960e-4b1f-a44e-82d643a82c81-delete_snapshot" released by "delete_snapshot" :: held 4.136s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:19 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" returned: 0 in 6.361s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a55f6-a605-473f-a959-461d241c1a72]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:19 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:19 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:20 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.698s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 01:57:20 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Converted 1024.00 MB image at 160.95 MB/s Jul 22 01:57:20 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:20 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc Jul 22 01:57:20 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:20 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" released by "_copy_volume_from_snapshot" :: held 8.429s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" released by "_create_volume_from_snapshot" :: held 8.501s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.542s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.634s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Creating offline snapshot 495224fa-b86b-4eb1-88bd-302ec14716ec of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a408b77-f547-4c63-8d91-085c20310f79]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-df839c68-2348-4647-9a61-f50271ac5294 tempest-GroupSnapshotsTest-325374833 None] Create group from source-snapshot-6912c8f3-ab13-4318-bcd7-dcdb61a078f2 completed successfully. Jul 22 01:57:21 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:21 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:21 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.496s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:21 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec 1G Jul 22 01:57:21 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a757a9-057f-4b21-b882-be932f2053be]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:22 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc Jul 22 01:57:22 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:22 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec 1G" returned: 0 in 0.657s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:22 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec Jul 22 01:57:22 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:22 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" returned: 0 in 0.557s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:22 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc Jul 22 01:57:22 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:22 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec" returned: 0 in 0.461s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:22 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec is being set with open permissions: ugo+rw Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:22 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec Jul 22 01:57:22 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:22 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" returned: 0 in 0.365s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-c5cdcb31-786e-4af3-bc6b-7ff44dde11fc" released by "delete_volume" :: held 0.993s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:22 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-01e00460-ce60-498c-8839-9e65f3573ef4 tempest-SnapshotsActionsTest-885585472 None] Create snapshot completed successfully Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Created reservations ['a603a863-4e93-4b38-baaf-e7a440e1ba40'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:23 devstack cinder-volume[87153]: WARNING cinder.quota [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2124874413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2124874413, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:57:23 devstack cinder-volume[87153]: WARNING cinder.quota [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2124874413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2124874413, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Created reservations ['92a2fdc5-926d-4482-9bfe-c16c94f21f48', '0f239651-9db2-4e1f-b8cf-e32da79fe5d8', '4f8c6e68-cdf1-4648-b909-a56bd9941748', 'ddb67175-bc85-4e3b-8ab9-99403ca7823d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:23 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:23 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:23 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-507f7a35-c18f-4525-92a7-9aa306bedbcb tempest-GroupSnapshotsTest-325374833 None] Delete group completed successfully. Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-495224fa-b86b-4eb1-88bd-302ec14716ec-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-495224fa-b86b-4eb1-88bd-302ec14716ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-495224fa-b86b-4eb1-88bd-302ec14716ec" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-495224fa-b86b-4eb1-88bd-302ec14716ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Deleting offline snapshot 495224fa-b86b-4eb1-88bd-302ec14716ec of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] snapshot_file for this snap is: volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eacb51d-0ece-47e5-8298-339484db0128]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:23 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec Jul 22 01:57:23 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:24 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe7f10-6a2d-48ee-bc16-32df8ed181a4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:24 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:24 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] group_snapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: deleting Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] group_snapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: deleting {{(pid=87153) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Deleting offline snapshot cde2c792-9062-4a94-9a36-f7c87e9da6ab of volume 9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] snapshot_file for this snap is: volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[df732543-3fb3-494a-b5b4-f91fedeb3540]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:24 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.583s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:24 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec Jul 22 01:57:24 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:24 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:24 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:25 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.525s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91b005e-ad87-4ccc-ac59-342d38b48597]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:25 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec" returned: 0 in 0.530s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:25 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec Jul 22 01:57:25 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:25 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:25 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:25 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.495224fa-b86b-4eb1-88bd-302ec14716ec" returned: 0 in 0.471s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-495224fa-b86b-4eb1-88bd-302ec14716ec" released by "_delete_snapshot" :: held 2.147s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_snapshot" :: held 2.187s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:26 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.709s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:26 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:26 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Created reservations ['79298596-6ac6-409e-833b-2aca8713bf8d', '78af71c3-8672-45da-9d24-acb9b6f01363', '1545c5c8-cbc2-4ba9-b16a-10fb02fc25e6', '87d13fdb-0e20-4861-955d-7106d5194aec'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Delete snapshot completed successfully. Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4918e17e-78b5-45ad-9082-6aad010035b7 tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-495224fa-b86b-4eb1-88bd-302ec14716ec-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:26 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.468s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:26 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab Jul 22 01:57:26 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:26 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4.cde2c792-9062-4a94-9a36-f7c87e9da6ab" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-cde2c792-9062-4a94-9a36-f7c87e9da6ab" released by "_delete_snapshot" :: held 2.129s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" released by "delete_snapshot" :: held 2.161s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:26 devstack cinder-volume[87153]: WARNING cinder.quota [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2124874413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2124874413, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:57:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['e9a8776b-4c6f-4b06-b61c-a69319229473', 'e711130c-29c4-4bf9-8815-3a6d8df2ba08', '75c7c044-81d6-4f2c-bdf4-25e267ff414e', '570713e8-cfca-42a0-bff0-b44f7e73208a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-64d69a81-75d1-4c5e-a74b-82b22d009d60 tempest-GroupSnapshotsTest-325374833 None] group_snapshot 6912c8f3-ab13-4318-bcd7-dcdb61a078f2: deleted successfully Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Creating offline snapshot 740557af-8e24-4166-9d93-38480f7befe5 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[176caee6-c45b-4d31-a720-2efd822f5622]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:27 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:27 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:27 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:27 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 1G Jul 22 01:57:27 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:28 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 1G" returned: 0 in 0.537s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:28 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 Jul 22 01:57:28 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" acquired by "delete_volume" :: waited 0.050s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c6b80-3519-44f5-ad87-9f4477c45503]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:28 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:28 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:28 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5" returned: 0 in 0.456s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:28 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 is being set with open permissions: ugo+rw Jul 22 01:57:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:28 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 Jul 22 01:57:28 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:29 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5" returned: 0 in 0.311s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:29 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.681s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-302d2178-8620-41c2-aa6d-b7878881f467 tempest-SnapshotsActionsTest-885585472 None] Create snapshot completed successfully Jul 22 01:57:29 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4 Jul 22 01:57:29 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:29 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" returned: 0 in 0.387s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-9b0f5ae5-820e-4838-a4ec-8caec2893cb4" released by "delete_volume" :: held 1.215s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-740557af-8e24-4166-9d93-38480f7befe5-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-740557af-8e24-4166-9d93-38480f7befe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Acquiring lock "cinder-quobyte-740557af-8e24-4166-9d93-38480f7befe5" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-740557af-8e24-4166-9d93-38480f7befe5" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Deleting offline snapshot 740557af-8e24-4166-9d93-38480f7befe5 of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] snapshot_file for this snap is: volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['075f3e2a-2684-4d7c-9b4f-d16df7444118'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3a5ab-b5c8-4e8f-b419-5bb848641e66]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:30 devstack cinder-volume[87153]: WARNING cinder.db.api [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2124874413'] Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['365993ae-ffd8-49c9-8fe3-72917eebbb31', '1978c7ef-9113-46fa-b973-105448d4edfb', 'b5f9ccfc-52b2-4fcd-8490-4940bf3bd867', 'ef4f82fe-bfea-4492-8ca0-e87c90cc61c7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:30 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 Jul 22 01:57:30 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:30 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:30 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:30 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5" returned: 0 in 0.507s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:30 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.344s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df70749-1631-4063-a262-875e10d8a3db]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2aebf566-ed74-4643-af9b-c84cbf3dfee1 tempest-GroupSnapshotsTest-325374833 None] Delete group completed successfully. Jul 22 01:57:30 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:30 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:30 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:31 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 Jul 22 01:57:31 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:31 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5" returned: 0 in 0.461s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:31 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5 Jul 22 01:57:31 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-70431595-4f60-4f49-86f0-8eb000748d62 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-1921911573: creating Jul 22 01:57:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-70431595-4f60-4f49-86f0-8eb000748d62 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-1921911573: created successfully Jul 22 01:57:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-70431595-4f60-4f49-86f0-8eb000748d62 tempest-GroupSnapshotsTest-325374833 None] Create group completed successfully. Jul 22 01:57:31 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.740557af-8e24-4166-9d93-38480f7befe5" returned: 0 in 0.355s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-740557af-8e24-4166-9d93-38480f7befe5" released by "_delete_snapshot" :: held 1.975s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_snapshot" :: held 2.039s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:32 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Created reservations ['df3d9191-3a6d-4261-8583-60707d568a27', 'cc409a6f-e13e-40b9-873b-4fe098e723d1', '7a3275af-1e06-41d5-93d0-9017a4595cf8', '6384dd9c-844c-449e-9b50-498a1b787841'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Delete snapshot completed successfully. Jul 22 01:57:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-40b82641-c2fd-471f-a3a3-d5c7e65c5d8f tempest-SnapshotsActionsTest-1509834104 None] Lock "cinder-740557af-8e24-4166-9d93-38480f7befe5-delete_snapshot" released by "delete_snapshot" :: held 2.267s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (8e913731-8488-484c-be34-212bf38e3d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa02382-ccfe-4069-ae63-82b7ea8a422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa02382-ccfe-4069-ae63-82b7ea8a422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685321048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85798507-440e-4137-9121-ddac1e12df20,host='devstack@QuobyteHD#QuobyteHD',id=b7de1c93-1656-4854-bc5e-3bccd9cfefd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:33Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde),volume_type_id=f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2848d951-111e-4a84-adf3-e5814b11dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2848d951-111e-4a84-adf3-e5814b11dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57a310-710f-4a5b-9788-e3ae37fdc970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57a310-710f-4a5b-9788-e3ae37fdc970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7de1c93-1656-4854-bc5e-3bccd9cfefd2', 'volume_name': 'volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe69114-73da-4ae1-88e3-71aed92cacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe69114-73da-4ae1-88e3-71aed92cacaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb8ae7-f4a3-4896-ab74-0049dd0811d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:33 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Volume b7de1c93-1656-4854-bc5e-3bccd9cfefd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2', 'volume_size': 1} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85798507-440e-4137-9121-ddac1e12df20,created_at=2026-07-21T23:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685321048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85798507-440e-4137-9121-ddac1e12df20,host='devstack@QuobyteHD#QuobyteHD',id=b7de1c93-1656-4854-bc5e-3bccd9cfefd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:33Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde),volume_type_id=f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Creating volume b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:57:33 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:33 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 1073741824 Jul 22 01:57:33 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "cinder-0977cace-7160-41c8-a3da-eb9650ea200a-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-0977cace-7160-41c8-a3da-eb9650ea200a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "cinder-quobyte-0977cace-7160-41c8-a3da-eb9650ea200a" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-0977cace-7160-41c8-a3da-eb9650ea200a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Deleting offline snapshot 0977cace-7160-41c8-a3da-eb9650ea200a of volume 6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] snapshot_file for this snap is: volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc4e88-e36f-40e5-a2d6-a8a1a3b8ae65]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:34 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:34 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:34 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 1073741824" returned: 0 in 0.634s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:34 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 Jul 22 01:57:34 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:34 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.501s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[54776bf5-a445-42ec-b7f1-bb02126d7831]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:34 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 Jul 22 01:57:34 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:34 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb8ae7-f4a3-4896-ab74-0049dd0811d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cdfaee-9c1e-4551-b793-d63ea14a81a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:34 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Volume volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 (b7de1c93-1656-4854-bc5e-3bccd9cfefd2): created successfully Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cdfaee-9c1e-4551-b793-d63ea14a81a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (8e913731-8488-484c-be34-212bf38e3d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-318c3dbe-6de3-47d3-b4e5-e4cca0833d74 tempest-GroupSnapshotsTest-325374833 None] Created volume successfully. Jul 22 01:57:34 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" returned: 0 in 0.448s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:35 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:35 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:35 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.411s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:35 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a Jul 22 01:57:35 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:35 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15.0977cace-7160-41c8-a3da-eb9650ea200a" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-0977cace-7160-41c8-a3da-eb9650ea200a" released by "_delete_snapshot" :: held 1.828s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_snapshot" :: held 1.873s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Created reservations ['86869d2e-7c7d-4e7f-9eb7-5aa74be4b59d', '9116e740-83bd-45e2-a1df-0fd6d65da74f', '748754ff-1425-41c0-bf1e-ce2ff803ffb6', '9f0b03e3-da32-4cd6-8363-1b8d39d006bb'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Delete snapshot completed successfully. Jul 22 01:57:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b8e64589-40a7-47a9-a01a-f98b299348bb tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-0977cace-7160-41c8-a3da-eb9650ea200a-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "cinder-6587352c-b03d-41fa-ac1f-0ab0ba1dad15-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-6587352c-b03d-41fa-ac1f-0ab0ba1dad15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c628a-59ff-4404-9d3a-7ba723c95d04]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:36 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 Jul 22 01:57:36 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:37 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" returned: 0 in 0.589s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=153,cinder:DELETE=8,cinder:SELECT=143,cinder:INSERT=38 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:57:37 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15 Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=141,cinder:INSERT=36,cinder:UPDATE=152,cinder:DELETE=12 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:57:37 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (d67bb8f3-ddbb-4c57-9dc1-1e70e756a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adba8fa-75ed-41b7-8a25-90058a520b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adba8fa-75ed-41b7-8a25-90058a520b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990412068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85798507-440e-4137-9121-ddac1e12df20,host='devstack@QuobyteHD#QuobyteHD',id=ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:37Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde),volume_type_id=f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb0c59e-59d4-427b-96c0-17f931339da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb0c59e-59d4-427b-96c0-17f931339da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1459df-64a3-46c7-ba54-e41ee4e7509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1459df-64a3-46c7-ba54-e41ee4e7509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d', 'volume_name': 'volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610c74c-102f-453b-b083-311792bd7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610c74c-102f-453b-b083-311792bd7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed04b01-1ee8-4591-9265-433921fd51c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Volume ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d', 'volume_size': 1} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=85798507-440e-4137-9121-ddac1e12df20,created_at=2026-07-21T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990412068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=85798507-440e-4137-9121-ddac1e12df20,host='devstack@QuobyteHD#QuobyteHD',id=ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:37Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde),volume_type_id=f2d77c9e-de1a-4fa5-9e81-6d3e9c434cde)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Creating volume ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:57:37 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:37 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d 1073741824 Jul 22 01:57:37 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:37 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" returned: 0 in 0.429s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-quobyte-6587352c-b03d-41fa-ac1f-0ab0ba1dad15" released by "delete_volume" :: held 1.113s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Created reservations ['9b5cdf7d-40ec-4062-9f16-9714a0119ad7', '2447e1b2-c98e-4b07-8841-36942777ef47', 'c80a8fa8-c7a7-49c9-8e0d-fa7cf57fa9c1', '557d45e6-ed8b-4525-abda-0841779e6e6f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:37 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:37 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:37 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d 1073741824" returned: 0 in 0.633s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:37 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d Jul 22 01:57:37 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:38 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.364s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Deleted volume successfully. Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ae0e0dc4-9176-4a00-bf5d-2e4d7d73dfb6 tempest-SnapshotsActionsTest-885585472 None] Lock "cinder-6587352c-b03d-41fa-ac1f-0ab0ba1dad15-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:38 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed04b01-1ee8-4591-9265-433921fd51c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c5425-74f4-4559-be24-aacfa4e0bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:38 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Volume volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d (ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d): created successfully Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2c5425-74f4-4559-be24-aacfa4e0bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (d67bb8f3-ddbb-4c57-9dc1-1e70e756a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f46de1c7-84ef-4ae7-8e08-070cc9d56220 tempest-GroupSnapshotsTest-325374833 None] Created volume successfully. Jul 22 01:57:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f9a3a25e-5b5c-4e4d-a8f4-165994344466 tempest-GroupSnapshotsTest-325374833 None] Update group completed successfully. Jul 22 01:57:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-22f7916d-a1d9-4ca6-a0f3-070f8e486b28 tempest-GroupSnapshotsTest-325374833 None] Update group completed successfully. Jul 22 01:57:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-824bef2d-760f-47f6-8d14-335fb7b1ae86 tempest-GroupSnapshotsTest-325374833 None] Update group completed successfully. Jul 22 01:57:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ab67e028-1a9d-40f9-92da-e8679eaf03c7 tempest-GroupSnapshotsTest-325374833 None] Update group completed successfully. Jul 22 01:57:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] GroupSnapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: creating. Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Group snapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: creating. {{(pid=87153) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Creating offline snapshot 330888df-6a77-4a18-b04b-b3b10c4b6aec of volume b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fa0ade-851d-4f51-8054-679ec71aa0a8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:45 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 Jul 22 01:57:45 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:46 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" returned: 0 in 0.611s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:46 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec 1G Jul 22 01:57:46 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:46 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec 1G" returned: 0 in 0.647s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:46 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec Jul 22 01:57:46 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:47 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec" returned: 0 in 0.512s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:47 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:47 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec Jul 22 01:57:47 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:47 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec" returned: 0 in 0.396s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:47 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info Jul 22 01:57:47 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:48 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:48 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:48 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info Jul 22 01:57:48 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:48 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.info" returned: 0 in 0.326s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Creating offline snapshot b55c319e-55cd-4ec3-94ea-992f74e3b816 of volume ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc4e6d-a683-4587-8ef4-7b9432dcc6c5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:48 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d Jul 22 01:57:48 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:48 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" returned: 0 in 0.507s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:49 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 1G Jul 22 01:57:49 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:49 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 1G" returned: 0 in 0.460s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:49 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 Jul 22 01:57:49 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:49 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816" returned: 0 in 0.418s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:49 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:49 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 Jul 22 01:57:49 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:50 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816" returned: 0 in 0.663s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:50 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info Jul 22 01:57:50 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:50 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info" returned: 0 in 0.395s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:57:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:51 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info Jul 22 01:57:51 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:51 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.info" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a3cbee8e-1f0f-445f-8a86-6de17d3cb580 tempest-GroupSnapshotsTest-325374833 None] group_snapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: created successfully Jul 22 01:57:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] group_snapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: deleting Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] group_snapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: deleting {{(pid=87153) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-330888df-6a77-4a18-b04b-b3b10c4b6aec" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-330888df-6a77-4a18-b04b-b3b10c4b6aec" acquired by "_delete_snapshot" :: waited 0.103s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:52 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:57:52 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Deleting offline snapshot 330888df-6a77-4a18-b04b-b3b10c4b6aec of volume b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] snapshot_file for this snap is: volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f765abb-ad93-43ea-a1fd-dd2775299b62]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:52 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec Jul 22 01:57:52 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:52 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.445s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:57:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:57:53 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec" returned: 0 in 1.002s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ca1e1-1981-4fce-8c44-fab302c97b49]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:54 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 Jul 22 01:57:54 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:54 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" returned: 0 in 0.918s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:54 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec Jul 22 01:57:54 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:55 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec" returned: 0 in 0.865s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:55 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec Jul 22 01:57:55 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:56 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2.330888df-6a77-4a18-b04b-b3b10c4b6aec" returned: 0 in 0.700s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-330888df-6a77-4a18-b04b-b3b10c4b6aec" released by "_delete_snapshot" :: held 3.817s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" released by "delete_snapshot" :: held 3.963s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-b55c319e-55cd-4ec3-94ea-992f74e3b816" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b55c319e-55cd-4ec3-94ea-992f74e3b816" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Deleting offline snapshot b55c319e-55cd-4ec3-94ea-992f74e3b816 of volume ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] snapshot_file for this snap is: volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb2979-48cd-4f68-a9db-79509e0346e1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:56 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 Jul 22 01:57:56 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:57 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816" returned: 0 in 0.736s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:57:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c1cd2f-2d63-4d6c-9b0d-1b6d3102f100]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:57:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:57 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d Jul 22 01:57:57 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:58 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" returned: 0 in 0.714s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:58 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 Jul 22 01:57:58 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Flow 'volume_create_manager' (f06a8457-91a0-4121-bfd2-7d91977eeb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b04e955-520b-4b9a-8361-03b5a6d31eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b04e955-520b-4b9a-8361-03b5a6d31eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1905379487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a7334e-ad24-42f0-9537-642dcdffe4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b01d2f6e405486bbf820a48ca3070d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:59Z,use_quota=True,user_id='b48ba0445b554cf1807341500af35b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(023984f2-26f9-428a-99d1-d1ca93b67a0a),volume_type_id=023984f2-26f9-428a-99d1-d1ca93b67a0a)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd66cf-dfdc-4cec-bc9f-a1be80d0a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd66cf-dfdc-4cec-bc9f-a1be80d0a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f45fa9f-3933-4a1c-87a1-2a2fdad0ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f45fa9f-3933-4a1c-87a1-2a2fdad0ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a7334e-ad24-42f0-9537-642dcdffe4df', 'volume_name': 'volume-b1a7334e-ad24-42f0-9537-642dcdffe4df', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe75df4-270c-4903-a98f-f43ab2c1cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:59 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe75df4-270c-4903-a98f-f43ab2c1cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb89473-3d03-46b7-bd3f-630575189189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:57:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Volume b1a7334e-ad24-42f0-9537-642dcdffe4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a7334e-ad24-42f0-9537-642dcdffe4df', 'volume_size': 1} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1905379487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a7334e-ad24-42f0-9537-642dcdffe4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b01d2f6e405486bbf820a48ca3070d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:57:59Z,use_quota=True,user_id='b48ba0445b554cf1807341500af35b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(023984f2-26f9-428a-99d1-d1ca93b67a0a),volume_type_id=023984f2-26f9-428a-99d1-d1ca93b67a0a)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Creating volume b1a7334e-ad24-42f0-9537-642dcdffe4df {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:57:59 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816" returned: 0 in 1.151s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:57:59 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df 1073741824 Jul 22 01:57:59 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:59 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816 Jul 22 01:57:59 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:57:59 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d.b55c319e-55cd-4ec3-94ea-992f74e3b816" returned: 0 in 0.548s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b55c319e-55cd-4ec3-94ea-992f74e3b816" released by "_delete_snapshot" :: held 3.391s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:57:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" released by "delete_snapshot" :: held 3.458s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:00 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:00 devstack cinder-volume[87153]: WARNING cinder.quota [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1222732861 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1222732861, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:00 devstack cinder-volume[87153]: WARNING cinder.quota [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1222732861 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1222732861, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df 1073741824" returned: 0 in 0.831s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['188c78f0-3aa1-4e35-87b5-49403c66a9c0', 'cba831d7-bf19-4b19-a7ff-695242bb68f9', '4cd70f54-7882-4001-beb6-0ca47554d093', '7b6de74a-8484-4427-a01a-099ab9e4ce4e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:00 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df Jul 22 01:58:00 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['fd3e1c7d-9291-4fac-b3c7-31ba3c575f0f', 'd2650ebe-08a7-4e25-8c7c-36b4f6a90684', '6782f629-4c0f-4920-856d-21c798682917', 'a73c058a-1ef2-40a5-9619-b8ed54cec923'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9542a8df-6d9f-453e-9865-b25c439188b3 tempest-GroupSnapshotsTest-325374833 None] group_snapshot d0aeff3b-bc0a-43e6-bdb5-b9a8ec0086a5: deleted successfully Jul 22 01:58:00 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb89473-3d03-46b7-bd3f-630575189189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a7334e-ad24-42f0-9537-642dcdffe4df', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475857b-6d4f-42db-bca5-a06c63188901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Volume volume-b1a7334e-ad24-42f0-9537-642dcdffe4df (b1a7334e-ad24-42f0-9537-642dcdffe4df): created successfully Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475857b-6d4f-42db-bca5-a06c63188901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Flow 'volume_create_manager' (f06a8457-91a0-4121-bfd2-7d91977eeb70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d3b69fc1-e596-4e44-9fc9-31347030ce0d tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Created volume successfully. Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[766a7bc9-2cb5-4fb2-944f-2c50c8311a92]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:01 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 Jul 22 01:58:01 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:01 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:01 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:02 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" returned: 0 in 0.591s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:02 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2 Jul 22 01:58:02 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:02 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.300s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-290441a8-118c-4827-83c1-680721b033e9 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Retype volume completed successfully. Jul 22 01:58:02 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b7de1c93-1656-4854-bc5e-3bccd9cfefd2" released by "delete_volume" :: held 1.007s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd608242-af6f-4ed0-9519-0dd44ae7f56d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:02 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d Jul 22 01:58:02 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:02 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" returned: 0 in 0.455s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:02 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d Jul 22 01:58:02 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:03 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-ccc8e3bb-5622-4ecd-9e6d-eedd7b032e3d" released by "delete_volume" :: held 0.807s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "cinder-b1a7334e-ad24-42f0-9537-642dcdffe4df-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "cinder-b1a7334e-ad24-42f0-9537-642dcdffe4df-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "cinder-quobyte-b1a7334e-ad24-42f0-9537-642dcdffe4df" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "cinder-quobyte-b1a7334e-ad24-42f0-9537-642dcdffe4df" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Created reservations ['ed905afb-5df7-48c1-8715-cfc1cab589e6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:03 devstack cinder-volume[87153]: WARNING cinder.quota [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1222732861 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1222732861, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a255d2bf-12ba-4504-9c4d-c7d632b5d67b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Created reservations ['03583556-037d-4ab4-82b7-da650174181b', '63da533e-95e0-46f1-8534-c3c0f209004c', 'a2b0f03d-fd1e-40d7-a55f-134bbca729cc', '6d73e3e0-5cd3-424b-bf84-0543c248af5b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:03 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df Jul 22 01:58:03 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Created reservations ['df311622-6d0d-42b3-838a-3b19fa079fc3', 'c91feb12-ea2e-4969-a4de-cf56f8cbbadd', 'cb73e866-f8c2-40da-992e-ad52bb74e3f4', '69cd03d4-4e95-4975-8875-e8b90b3079ef'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:03 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:03 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:03 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df" returned: 0 in 0.499s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:04 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df Jul 22 01:58:04 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:04 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.453s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c464796d-c166-4a14-a72a-a3bface86a9c tempest-GroupSnapshotsTest-325374833 None] Delete group completed successfully. Jul 22 01:58:04 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b1a7334e-ad24-42f0-9537-642dcdffe4df" returned: 0 in 0.437s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "cinder-quobyte-b1a7334e-ad24-42f0-9537-642dcdffe4df" released by "delete_volume" :: held 1.030s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:04 devstack cinder-volume[87153]: WARNING cinder.quota [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:04 devstack cinder-volume[87153]: WARNING cinder.quota [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Created reservations ['8196b318-d72a-416c-b2ce-63569ab1e92c', 'd09a8b65-52b2-4bd0-959b-1b10cb9a4c31', 'f155d160-5325-47d5-b64a-1d33b731fed1', '8f389de9-cc1a-4aa2-bc01-3b27ec0dab28'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:04 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:04 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9daa184b-ac5b-4dbf-b638-ec202f1458d4 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-2020262245: creating Jul 22 01:58:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9daa184b-ac5b-4dbf-b638-ec202f1458d4 tempest-GroupSnapshotsTest-325374833 None] Group tempest-GroupSnapshotsTest-Group-2020262245: created successfully Jul 22 01:58:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9daa184b-ac5b-4dbf-b638-ec202f1458d4 tempest-GroupSnapshotsTest-325374833 None] Create group completed successfully. Jul 22 01:58:04 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.325s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:04 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Deleted volume successfully. Jul 22 01:58:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99f3cce7-4d22-449a-b95d-14033ad58369 tempest-VolumeRetypeWithoutMigrationTest-315340031 None] Lock "cinder-b1a7334e-ad24-42f0-9537-642dcdffe4df-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (a078f1bd-ea77-4259-aa70-74fcedb6a758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c242e3-c943-4164-8a3c-fd616c351188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c242e3-c943-4164-8a3c-fd616c351188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353286239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f123cdf0-0f37-4afd-85b7-975da49429d1,host='devstack@QuobyteHD#QuobyteHD',id=b3904aad-462a-4746-a54d-fb5b42412011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:06Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50d3546f-1b75-41fb-b2a5-44c83dc78dfe),volume_type_id=50d3546f-1b75-41fb-b2a5-44c83dc78dfe)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3362a9-6e78-4ec7-b25c-f1cfdb98c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3362a9-6e78-4ec7-b25c-f1cfdb98c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada7afc7-5fec-4ebb-894b-8ad535a7f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada7afc7-5fec-4ebb-894b-8ad535a7f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3904aad-462a-4746-a54d-fb5b42412011', 'volume_name': 'volume-b3904aad-462a-4746-a54d-fb5b42412011', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e50ceef-5f37-47b2-b924-912b2cf2c176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e50ceef-5f37-47b2-b924-912b2cf2c176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcdd1c-d82d-4dfa-a9ea-f3d06d9e8121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Volume b3904aad-462a-4746-a54d-fb5b42412011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3904aad-462a-4746-a54d-fb5b42412011', 'volume_size': 1} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f123cdf0-0f37-4afd-85b7-975da49429d1,created_at=2026-07-21T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353286239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f123cdf0-0f37-4afd-85b7-975da49429d1,host='devstack@QuobyteHD#QuobyteHD',id=b3904aad-462a-4746-a54d-fb5b42412011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd5eee0d9c4b84a65824cf012c0117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:06Z,use_quota=True,user_id='348173e3a3a54ccfa66c278aee571b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50d3546f-1b75-41fb-b2a5-44c83dc78dfe),volume_type_id=50d3546f-1b75-41fb-b2a5-44c83dc78dfe)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Creating volume b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:06 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 1073741824 Jul 22 01:58:06 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:07 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 1073741824" returned: 0 in 0.560s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:07 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 Jul 22 01:58:07 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:07 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011" returned: 0 in 0.297s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcdd1c-d82d-4dfa-a9ea-f3d06d9e8121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3904aad-462a-4746-a54d-fb5b42412011', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a07a48a-e2cf-4e95-ae6c-b5edc104fc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Volume volume-b3904aad-462a-4746-a54d-fb5b42412011 (b3904aad-462a-4746-a54d-fb5b42412011): created successfully Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a07a48a-e2cf-4e95-ae6c-b5edc104fc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Flow 'volume_create_manager' (a078f1bd-ea77-4259-aa70-74fcedb6a758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f76cda7c-1461-483a-ad32-07d18091c861 tempest-GroupSnapshotsTest-325374833 None] Created volume successfully. Jul 22 01:58:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] GroupSnapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: creating. Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Group snapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: creating. {{(pid=87153) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Creating offline snapshot 552664dc-afaa-4749-bf3d-de9c2dcac6be of volume b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d4ba6e-e399-4581-b8d1-1b15b304cb2b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:09 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 Jul 22 01:58:09 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:09 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011" returned: 0 in 0.384s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:09 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be 1G Jul 22 01:58:09 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:09 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be 1G" returned: 0 in 0.446s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3904aad-462a-4746-a54d-fb5b42412011 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:10 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3904aad-462a-4746-a54d-fb5b42412011 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be Jul 22 01:58:10 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:10 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3904aad-462a-4746-a54d-fb5b42412011 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:10 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:58:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:10 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be Jul 22 01:58:10 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:10 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:10 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info Jul 22 01:58:10 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:11 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:11 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:11 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info Jul 22 01:58:11 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:11 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.info" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9225827f-e5dc-4239-ae58-0f2c562557cc tempest-GroupSnapshotsTest-325374833 None] group_snapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: created successfully Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Flow 'volume_create_manager' (c81c73f3-ccd6-444e-865d-f3db93142d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700597a6-c847-4fff-a9f3-85cf231c7b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700597a6-c847-4fff-a9f3-85cf231c7b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1036711512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867bb362-92e4-4dd0-a555-7deda34c2e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa6338935a642e4916c4c39c26742da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:12Z,use_quota=True,user_id='79f68fac7a85477c8bbea5038e05376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51f44ca-0853-4a94-9323-8d83588eeefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51f44ca-0853-4a94-9323-8d83588eeefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132a36b-f03f-4b9c-a192-7b5b7e29dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132a36b-f03f-4b9c-a192-7b5b7e29dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867bb362-92e4-4dd0-a555-7deda34c2e10', 'volume_name': 'volume-867bb362-92e4-4dd0-a555-7deda34c2e10', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb2311-d21b-499a-9272-6845de17cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb2311-d21b-499a-9272-6845de17cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c31664e-9e24-483f-a1b8-ef193bec2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:11 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Volume 867bb362-92e4-4dd0-a555-7deda34c2e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867bb362-92e4-4dd0-a555-7deda34c2e10', 'volume_size': 1} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1036711512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867bb362-92e4-4dd0-a555-7deda34c2e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa6338935a642e4916c4c39c26742da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:12Z,use_quota=True,user_id='79f68fac7a85477c8bbea5038e05376a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Creating volume 867bb362-92e4-4dd0-a555-7deda34c2e10 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:11 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:11 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 1073741824 Jul 22 01:58:11 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:12 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 1073741824" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:12 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 Jul 22 01:58:12 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:12 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c31664e-9e24-483f-a1b8-ef193bec2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867bb362-92e4-4dd0-a555-7deda34c2e10', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d9ec1-4bb6-4cb6-a477-4fc8a2289138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:12 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Volume volume-867bb362-92e4-4dd0-a555-7deda34c2e10 (867bb362-92e4-4dd0-a555-7deda34c2e10): created successfully Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d9ec1-4bb6-4cb6-a477-4fc8a2289138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Flow 'volume_create_manager' (c81c73f3-ccd6-444e-865d-f3db93142d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-76e5f194-23b4-46f8-997b-75fbd0bb2400 tempest-VolumesServicesTestJSON-56486213 None] Created volume successfully. Jul 22 01:58:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] group_snapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: deleting Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] group_snapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: deleting {{(pid=87153) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-552664dc-afaa-4749-bf3d-de9c2dcac6be" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-552664dc-afaa-4749-bf3d-de9c2dcac6be" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Deleting offline snapshot 552664dc-afaa-4749-bf3d-de9c2dcac6be of volume b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] snapshot_file for this snap is: volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b7a28-c1e1-4f5c-b432-1dd44842af84]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Acquiring lock "cinder-867bb362-92e4-4dd0-a555-7deda34c2e10-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:12 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be Jul 22 01:58:12 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "cinder-867bb362-92e4-4dd0-a555-7deda34c2e10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Acquiring lock "cinder-quobyte-867bb362-92e4-4dd0-a555-7deda34c2e10" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "cinder-quobyte-867bb362-92e4-4dd0-a555-7deda34c2e10" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3a2bd-d0b0-4407-b332-671e7a114f26]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 Jul 22 01:58:13 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:13 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be" returned: 0 in 0.453s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3904aad-462a-4746-a54d-fb5b42412011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f65f92-6bdd-4aea-8f59-d7d1cc0ac298]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 Jul 22 01:58:13 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:13 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10 Jul 22 01:58:13 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:13 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be Jul 22 01:58:13 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:13 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-867bb362-92e4-4dd0-a555-7deda34c2e10" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "cinder-quobyte-867bb362-92e4-4dd0-a555-7deda34c2e10" released by "delete_volume" :: held 0.707s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Created reservations ['b35d4079-a3e8-46e9-ac4f-7a3ed705a236', '3cdba1b9-f83e-45ca-8620-df620a7c05a7', '826e095a-a3e3-4c5b-b7bd-a28f36a85309', 'd8192c9f-ddf5-43fb-afda-65766d9cda3e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:13 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:13 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:13 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be Jul 22 01:58:13 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:14 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:14 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Deleted volume successfully. Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f66fe74d-d62a-47ef-a57e-198bb64c2a1d tempest-VolumesServicesTestJSON-56486213 None] Lock "cinder-867bb362-92e4-4dd0-a555-7deda34c2e10-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:14 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011.552664dc-afaa-4749-bf3d-de9c2dcac6be" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-552664dc-afaa-4749-bf3d-de9c2dcac6be" released by "_delete_snapshot" :: held 1.556s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" released by "delete_snapshot" :: held 1.580s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:14 devstack cinder-volume[87153]: WARNING cinder.quota [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-737478465 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-737478465, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:14 devstack cinder-volume[87153]: WARNING cinder.quota [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-737478465 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-737478465, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:14 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['4e0b713f-d705-4cd7-9391-5c5fa822a076', '323af500-bd53-40a0-8500-dafa6c652005', '2ba481c7-3720-438b-b8c5-548e11d280c4', '52dab7e4-fb11-4768-9d26-358b88518822'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:14 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b72265bd-1ae7-4bec-acee-d2b4f9f8c5b1 tempest-GroupSnapshotsTest-325374833 None] group_snapshot e82cc0b5-1bcd-4d86-878a-c86571f05b0d: deleted successfully Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f024ad-26f6-4f13-8963-ce4cf2a9ec2e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:15 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 Jul 22 01:58:15 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:15 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011" returned: 0 in 0.405s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:15 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011 Jul 22 01:58:15 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:15 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b3904aad-462a-4746-a54d-fb5b42412011" returned: 0 in 0.281s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Lock "cinder-quobyte-b3904aad-462a-4746-a54d-fb5b42412011" released by "delete_volume" :: held 0.753s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:15 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['a701b1a6-c463-4b5d-aa64-c6afa30b7d58'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:16 devstack cinder-volume[87153]: WARNING cinder.quota [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-737478465 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-737478465, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Created reservations ['5e03400f-a87d-4b74-bb70-5a6ad1441940', 'eff9cbb2-a3d9-49dc-ad9f-195ff94245f0', 'e743c07b-039f-4b42-988a-f0586f8983d8', 'f899fc2f-effa-4786-a180-6ce129ad80d1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:16 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:16 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:16 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:16 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0320420a-5ad5-49d0-a81b-3854af34fb22 tempest-GroupSnapshotsTest-325374833 None] Delete group completed successfully. Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Flow 'volume_create_manager' (8c71789e-93ce-49fa-a0cc-03807e482e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc28836-2114-408f-8206-52817cf76e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc28836-2114-408f-8206-52817cf76e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1702103172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49f8efb-f213-4509-bee9-264f037cc2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb710b4ec86947fb9de3b34ea4027a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:18Z,use_quota=True,user_id='eb29e5cc722a4001b3bdd3cb96182dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a12a011-612e-4cd6-a2dc-ba88f1e0de84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a12a011-612e-4cd6-a2dc-ba88f1e0de84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b166daa1-a49a-456d-84a5-e60d9acd706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b166daa1-a49a-456d-84a5-e60d9acd706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49f8efb-f213-4509-bee9-264f037cc2c1', 'volume_name': 'volume-c49f8efb-f213-4509-bee9-264f037cc2c1', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d07ea6d-1336-42ad-8072-854f45a24d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d07ea6d-1336-42ad-8072-854f45a24d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b84c0b-b639-45cc-8ccf-f56e64f6f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Volume c49f8efb-f213-4509-bee9-264f037cc2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49f8efb-f213-4509-bee9-264f037cc2c1', 'volume_size': 1} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1702103172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49f8efb-f213-4509-bee9-264f037cc2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb710b4ec86947fb9de3b34ea4027a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:18Z,use_quota=True,user_id='eb29e5cc722a4001b3bdd3cb96182dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Creating volume c49f8efb-f213-4509-bee9-264f037cc2c1 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:18 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 1073741824 Jul 22 01:58:18 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:18 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 1073741824" returned: 0 in 0.550s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:18 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 Jul 22 01:58:18 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:19 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1" returned: 0 in 0.383s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b84c0b-b639-45cc-8ccf-f56e64f6f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49f8efb-f213-4509-bee9-264f037cc2c1', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869d2f9b-af11-4bc3-b42c-77478ff9203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Volume volume-c49f8efb-f213-4509-bee9-264f037cc2c1 (c49f8efb-f213-4509-bee9-264f037cc2c1): created successfully Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869d2f9b-af11-4bc3-b42c-77478ff9203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Flow 'volume_create_manager' (8c71789e-93ce-49fa-a0cc-03807e482e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2e25a171-a3c1-4b6f-ae0d-8056ff601b3d tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Created volume successfully. Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (b2a70a47-4c4f-4970-9781-36dae561def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5519eb8-541e-4a4b-9cfb-f425ee85a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5519eb8-541e-4a4b-9cfb-f425ee85a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-364912027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296c2776-c322-41ba-b39e-5df959618ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:20Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb29721-671d-4a0a-9f5c-54067d091f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb29721-671d-4a0a-9f5c-54067d091f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfb4b9-9e2b-4417-ab38-16390db3be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfb4b9-9e2b-4417-ab38-16390db3be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296c2776-c322-41ba-b39e-5df959618ddb', 'volume_name': 'volume-296c2776-c322-41ba-b39e-5df959618ddb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4052a482-a171-4188-94d7-93cce3d177f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4052a482-a171-4188-94d7-93cce3d177f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66960be6-5c9d-473f-9c71-de69afc3c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Volume 296c2776-c322-41ba-b39e-5df959618ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296c2776-c322-41ba-b39e-5df959618ddb', 'volume_size': 1} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-364912027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296c2776-c322-41ba-b39e-5df959618ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:20Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Creating volume 296c2776-c322-41ba-b39e-5df959618ddb {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:20 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:20 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb 1073741824 Jul 22 01:58:20 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:21 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb 1073741824" returned: 0 in 0.560s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:21 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb Jul 22 01:58:21 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:21 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb" returned: 0 in 0.380s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66960be6-5c9d-473f-9c71-de69afc3c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296c2776-c322-41ba-b39e-5df959618ddb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319baec3-bf2f-4ea6-a41a-d8190e32f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:21 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Volume volume-296c2776-c322-41ba-b39e-5df959618ddb (296c2776-c322-41ba-b39e-5df959618ddb): created successfully Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319baec3-bf2f-4ea6-a41a-d8190e32f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (b2a70a47-4c4f-4970-9781-36dae561def0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-49c8248f-e9ef-4e7b-8f6d-5e9b182e3380 tempest-AttachVolumeNegativeTest-739521749 None] Created volume successfully. Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3c10419d-69da-4078-a1af-3b4058a4a160 req-8f8b2f66-156c-4b37-b43a-79adf71af0f7 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3c10419d-69da-4078-a1af-3b4058a4a160 req-8f8b2f66-156c-4b37-b43a-79adf71af0f7 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3c10419d-69da-4078-a1af-3b4058a4a160 req-8f8b2f66-156c-4b37-b43a-79adf71af0f7 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3c10419d-69da-4078-a1af-3b4058a4a160 req-8f8b2f66-156c-4b37-b43a-79adf71af0f7 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-c49f8efb-f213-4509-bee9-264f037cc2c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd23cdc7a-b20e-42d1-ace4-600480cff0e0', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:58:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3c10419d-69da-4078-a1af-3b4058a4a160 req-8f8b2f66-156c-4b37-b43a-79adf71af0f7 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] attachment_update completed successfully. Jul 22 01:58:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3cde6bd1-0c2a-49e4-b08b-390580a9d50a tempest-GroupSnapshotsV319Test-554286578 None] Group tempest-GroupSnapshotsV319Test-Group-1957892587: creating Jul 22 01:58:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3cde6bd1-0c2a-49e4-b08b-390580a9d50a tempest-GroupSnapshotsV319Test-554286578 None] Group tempest-GroupSnapshotsV319Test-Group-1957892587: created successfully Jul 22 01:58:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3cde6bd1-0c2a-49e4-b08b-390580a9d50a tempest-GroupSnapshotsV319Test-554286578 None] Create group completed successfully. Jul 22 01:58:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-459b449e-83b5-4e79-9a4a-81bacddfa047 req-786c9c98-3b69-41b5-a035-14d5b5441010 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-459b449e-83b5-4e79-9a4a-81bacddfa047 req-786c9c98-3b69-41b5-a035-14d5b5441010 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-459b449e-83b5-4e79-9a4a-81bacddfa047 req-786c9c98-3b69-41b5-a035-14d5b5441010 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-459b449e-83b5-4e79-9a4a-81bacddfa047 req-786c9c98-3b69-41b5-a035-14d5b5441010 tempest-AttachVolumeNegativeTest-739521749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-296c2776-c322-41ba-b39e-5df959618ddb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5eb4b972-7149-480e-8693-685073b02342', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:58:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-459b449e-83b5-4e79-9a4a-81bacddfa047 req-786c9c98-3b69-41b5-a035-14d5b5441010 tempest-AttachVolumeNegativeTest-739521749 None] attachment_update completed successfully. Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Flow 'volume_create_manager' (914d320b-ccd7-4603-a1f3-98d03a2aaa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5120b33e-0552-4b16-a809-7775e07f5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5120b33e-0552-4b16-a809-7775e07f5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-337209579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ca81886-52d7-4c4e-b2d1-9cba04482069,host='devstack@QuobyteHD#QuobyteHD',id=5539084c-31d0-4d40-95f0-00fc3b1e0d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705b141b3b1f4e1e9bc92db032e2726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:25Z,use_quota=True,user_id='50a6444b95f44d60b16ae0f9365085a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ce78e2a-5d4b-44d6-bf4a-2599fdd2a880),volume_type_id=6ce78e2a-5d4b-44d6-bf4a-2599fdd2a880)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73b562-a709-48f4-98bd-0e4579e0d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a73b562-a709-48f4-98bd-0e4579e0d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91181c23-2b1b-45a9-9a20-c95c39cb4e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91181c23-2b1b-45a9-9a20-c95c39cb4e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5539084c-31d0-4d40-95f0-00fc3b1e0d62', 'volume_name': 'volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02fa1fa-93aa-4583-bac4-65a72ce438c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02fa1fa-93aa-4583-bac4-65a72ce438c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96111bc5-e934-40ab-9fad-ea4f0d6fa27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Volume 5539084c-31d0-4d40-95f0-00fc3b1e0d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62', 'volume_size': 1} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ca81886-52d7-4c4e-b2d1-9cba04482069,created_at=2026-07-21T23:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-337209579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ca81886-52d7-4c4e-b2d1-9cba04482069,host='devstack@QuobyteHD#QuobyteHD',id=5539084c-31d0-4d40-95f0-00fc3b1e0d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='705b141b3b1f4e1e9bc92db032e2726f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:25Z,use_quota=True,user_id='50a6444b95f44d60b16ae0f9365085a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ce78e2a-5d4b-44d6-bf4a-2599fdd2a880),volume_type_id=6ce78e2a-5d4b-44d6-bf4a-2599fdd2a880)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Creating volume 5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:25 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:25 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 1073741824 Jul 22 01:58:25 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-a00d098c-7c69-420b-8b3d-e7606dd39ee5 req-9bc4ea91-64ac-4e1d-b173-a03c31f2a1c0 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Terminate volume connection completed successfully. Jul 22 01:58:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-a00d098c-7c69-420b-8b3d-e7606dd39ee5 req-9bc4ea91-64ac-4e1d-b173-a03c31f2a1c0 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Deleting attachment d23cdc7a-b20e-42d1-ace4-600480cff0e0. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:58:25 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 1073741824" returned: 0 in 0.599s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:26 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 Jul 22 01:58:26 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:26 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62" returned: 0 in 0.290s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96111bc5-e934-40ab-9fad-ea4f0d6fa27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d04e272-b205-49ea-b44d-1666d7b71f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Volume volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 (5539084c-31d0-4d40-95f0-00fc3b1e0d62): created successfully Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d04e272-b205-49ea-b44d-1666d7b71f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Flow 'volume_create_manager' (914d320b-ccd7-4603-a1f3-98d03a2aaa43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dcfbcf00-491e-4796-8ab6-e31edadcc9d1 tempest-GroupSnapshotsV319Test-554286578 None] Created volume successfully. Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "cinder-c49f8efb-f213-4509-bee9-264f037cc2c1-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "cinder-c49f8efb-f213-4509-bee9-264f037cc2c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "cinder-quobyte-c49f8efb-f213-4509-bee9-264f037cc2c1" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "cinder-quobyte-c49f8efb-f213-4509-bee9-264f037cc2c1" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa7cc9a-59ae-469f-875d-a2f4aa38b9ba]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:26 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 Jul 22 01:58:26 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:27 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1" returned: 0 in 0.441s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:27 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1 Jul 22 01:58:27 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:27 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c49f8efb-f213-4509-bee9-264f037cc2c1" returned: 0 in 0.270s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "cinder-quobyte-c49f8efb-f213-4509-bee9-264f037cc2c1" released by "delete_volume" :: held 0.763s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Created reservations ['2ecd981a-c46b-4740-8f29-20910a0b12ff', '7283003e-65ed-4940-8e9f-d2fc41e32fbe', '6ebfd709-e2cb-4a22-8ab9-e40bac2d285a', '86f1b9c5-2846-43fd-be05-51d1754bce32'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:27 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:27 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:28 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.380s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Deleted volume successfully. Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b69d082c-3021-43b1-9411-b928b88e28d6 tempest-TestServerVolumeAttachScenarioOldVersion-826096623 None] Lock "cinder-c49f8efb-f213-4509-bee9-264f037cc2c1-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] GroupSnapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: creating. Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Group snapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: creating. {{(pid=87153) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Creating offline snapshot 690ef151-9bcc-4c40-9e64-db761e838dbb of volume 5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c7c4e-7dc8-4b58-a551-aa7bc2cb9c8f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:28 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 Jul 22 01:58:28 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:28 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62" returned: 0 in 0.688s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:29 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb 1G Jul 22 01:58:29 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:29 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb 1G" returned: 0 in 0.769s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:29 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb Jul 22 01:58:29 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:30 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb" returned: 0 in 0.766s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:30 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:58:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:30 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb Jul 22 01:58:30 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:30 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:31 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info Jul 22 01:58:31 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:31 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info" returned: 0 in 0.466s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:31 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:58:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:31 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info Jul 22 01:58:31 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:31 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.info" returned: 0 in 0.390s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.648s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4123e61d-52eb-4e10-b3c3-d6750a016470 tempest-GroupSnapshotsV319Test-554286578 None] group_snapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: created successfully Jul 22 01:58:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] group_snapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: deleting Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] group_snapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: deleting {{(pid=87153) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "cinder-quobyte-690ef151-9bcc-4c40-9e64-db761e838dbb" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-690ef151-9bcc-4c40-9e64-db761e838dbb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Deleting offline snapshot 690ef151-9bcc-4c40-9e64-db761e838dbb of volume 5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] snapshot_file for this snap is: volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c47e0-b9f6-4ac1-b76d-8684a0ac90de]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:33 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb Jul 22 01:58:33 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:33 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb" returned: 0 in 0.436s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6bd2a-3dea-4552-9988-ca40fb450761]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:34 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 Jul 22 01:58:34 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:34 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62" returned: 0 in 0.523s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:34 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb Jul 22 01:58:34 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:35 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb" returned: 0 in 0.867s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:35 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb Jul 22 01:58:35 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Flow 'volume_create_manager' (1afcc5ed-91ab-4af5-99cd-a3bd55e04569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e671cce-1b4f-4f10-8af7-686546ef40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e671cce-1b4f-4f10-8af7-686546ef40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1619683164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad4045-4a62-4239-ae34-0b3e2c8fe8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd56b289b661489a9ba5751249a97634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:35Z,use_quota=True,user_id='4e3fe5e055e04a79b8353893f9d82fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72533d19-524f-430d-92d2-84e85ca1cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72533d19-524f-430d-92d2-84e85ca1cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8561c23-fb3f-4b57-9ca0-f4210c51cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8561c23-fb3f-4b57-9ca0-f4210c51cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfad4045-4a62-4239-ae34-0b3e2c8fe8c0', 'volume_name': 'volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7665789b-f7d4-44ac-9523-6233dd0335af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7665789b-f7d4-44ac-9523-6233dd0335af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9c0b3-5f43-4f34-b8da-4e028ae3fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:35 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Volume dfad4045-4a62-4239-ae34-0b3e2c8fe8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0', 'volume_size': 1} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1619683164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad4045-4a62-4239-ae34-0b3e2c8fe8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd56b289b661489a9ba5751249a97634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:35Z,use_quota=True,user_id='4e3fe5e055e04a79b8353893f9d82fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Creating volume dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:35 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:35 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 1073741824 Jul 22 01:58:35 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:35 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62.690ef151-9bcc-4c40-9e64-db761e838dbb" returned: 0 in 0.566s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-690ef151-9bcc-4c40-9e64-db761e838dbb" released by "_delete_snapshot" :: held 2.550s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" released by "delete_snapshot" :: held 2.586s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:36 devstack cinder-volume[87153]: WARNING cinder.quota [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1569145945 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1569145945, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:36 devstack cinder-volume[87153]: WARNING cinder.quota [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1569145945 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1569145945, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] Created reservations ['6e0f2f0c-e36f-4cb8-b47b-3f08cc016dff', 'f2cd7ae1-5a40-42e3-84ff-fd0041c7ccd2', 'af609caa-d9b8-4ec2-ba6e-cbb2997d87d5', '91748afe-8796-4d61-b4df-afed11b9c3e3'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e0d695e3-3c23-4f10-a2c0-f95c36f03a88 tempest-GroupSnapshotsV319Test-554286578 None] group_snapshot 783968ed-ec4b-4c1b-80dd-f084c8cef832: deleted successfully Jul 22 01:58:36 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 1073741824" returned: 0 in 0.786s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:36 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 Jul 22 01:58:36 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:36 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc9c0b3-5f43-4f34-b8da-4e028ae3fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e7d2f9-8246-471c-bbaa-cd25b5fd9cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Volume volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 (dfad4045-4a62-4239-ae34-0b3e2c8fe8c0): created successfully Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e7d2f9-8246-471c-bbaa-cd25b5fd9cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Flow 'volume_create_manager' (1afcc5ed-91ab-4af5-99cd-a3bd55e04569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-49da6750-0a42-40bb-a40a-4c4e3fe8b14f tempest-AbsoluteLimitsTests-2008419792 None] Created volume successfully. Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=145,cinder:INSERT=28,cinder:UPDATE=133,cinder:DELETE=6 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=123,cinder:INSERT=30,cinder:UPDATE=128,cinder:DELETE=6 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" acquired by "delete_volume" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2c3a45-a84d-4e83-9c8e-aa75e8c9fd32]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:37 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 Jul 22 01:58:37 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Acquiring lock "cinder-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "cinder-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Acquiring lock "cinder-quobyte-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "cinder-quobyte-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2639e83-0b6e-4850-aeb5-e5aec0a4339d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:38 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62" returned: 0 in 0.656s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:38 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 Jul 22 01:58:38 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:38 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62 Jul 22 01:58:38 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:38 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5539084c-31d0-4d40-95f0-00fc3b1e0d62" returned: 0 in 0.516s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Lock "cinder-quobyte-5539084c-31d0-4d40-95f0-00fc3b1e0d62" released by "delete_volume" :: held 1.303s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:38 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" returned: 0 in 0.805s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:38 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0 Jul 22 01:58:38 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:38 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Created reservations ['de4def65-ab56-465d-9515-397c7efec896'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:39 devstack cinder-volume[87153]: WARNING cinder.quota [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1569145945 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1569145945, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Created reservations ['75c69e57-757e-4438-821f-78bc70111a1d', '4fa19cb5-db7d-48d2-89a2-1a4138a0ac5a', '12f34f61-d920-46f1-8b8c-31febae97b3a', '481414a3-4c41-462a-a8fc-e84576d1728d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:39 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:39 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:39 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" returned: 0 in 0.689s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "cinder-quobyte-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0" released by "delete_volume" :: held 1.582s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Created reservations ['e80ca954-2438-49da-b038-3812762318f9', '7aee12b4-bcd3-41ac-bb54-d210e3306f79', '11e9ae5f-edbc-49a9-90fa-6f85cdd3254d', 'ac69d092-b0ae-4914-93c1-a8a9f9edb583'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:39 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fa12e117-2922-4b7e-a6cd-7d318d3dd6f9 tempest-GroupSnapshotsV319Test-554286578 None] Delete group completed successfully. Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:39 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:39 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:40 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.466s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:40 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Deleted volume successfully. Jul 22 01:58:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-234f56d6-2d63-43e9-8bdf-8515befdbb2f tempest-AbsoluteLimitsTests-2008419792 None] Lock "cinder-dfad4045-4a62-4239-ae34-0b3e2c8fe8c0-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Flow 'volume_create_manager' (b7532c48-e6b4-4338-9c86-fcbceea47b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d470b3bd-3de2-401d-807c-45652408103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d470b3bd-3de2-401d-807c-45652408103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1721227488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5934c8fc-35a2-4199-b8a1-bc7e96cc137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2eb883bae54047b75428e839a44b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:48Z,use_quota=True,user_id='c49abca2320341fc9f6fa2e01e414625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e8884-a931-49b3-9d5b-753066987458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643e8884-a931-49b3-9d5b-753066987458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e0a8a6-1ec7-4ef7-b59b-14f3fa01f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e0a8a6-1ec7-4ef7-b59b-14f3fa01f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5934c8fc-35a2-4199-b8a1-bc7e96cc137c', 'volume_name': 'volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30a585b-27f0-4779-b7bf-981e23005c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30a585b-27f0-4779-b7bf-981e23005c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901f346-4176-4518-ade9-f55841762beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Volume 5934c8fc-35a2-4199-b8a1-bc7e96cc137c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c', 'volume_size': 1} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1721227488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5934c8fc-35a2-4199-b8a1-bc7e96cc137c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a2eb883bae54047b75428e839a44b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:48Z,use_quota=True,user_id='c49abca2320341fc9f6fa2e01e414625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Creating volume 5934c8fc-35a2-4199-b8a1-bc7e96cc137c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:48 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c 1073741824 Jul 22 01:58:48 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:49 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c 1073741824" returned: 0 in 0.620s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:49 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c Jul 22 01:58:49 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:49 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" returned: 0 in 0.342s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901f346-4176-4518-ade9-f55841762beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6fb158-efd8-49e6-a5eb-61461be86866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:49 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Volume volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c (5934c8fc-35a2-4199-b8a1-bc7e96cc137c): created successfully Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6fb158-efd8-49e6-a5eb-61461be86866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Flow 'volume_create_manager' (b7532c48-e6b4-4338-9c86-fcbceea47b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a01c9574-e897-458e-81dc-6b4d6faa0e13 tempest-VolumesMetadataTest-725214954 None] Created volume successfully. Jul 22 01:58:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e7409417-95bb-4454-a153-9d3bc3b3b30c tempest-GroupsTest-196943186 None] Group tempest-Group1-1509841776: creating Jul 22 01:58:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e7409417-95bb-4454-a153-9d3bc3b3b30c tempest-GroupsTest-196943186 None] Group tempest-Group1-1509841776: created successfully Jul 22 01:58:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e7409417-95bb-4454-a153-9d3bc3b3b30c tempest-GroupsTest-196943186 None] Create group completed successfully. Jul 22 01:58:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-555dc089-846a-4c3e-84c5-d8b5dacac74e tempest-GroupsTest-196943186 None] Group tempest-Group2-1455467091: creating Jul 22 01:58:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-555dc089-846a-4c3e-84c5-d8b5dacac74e tempest-GroupsTest-196943186 None] Group tempest-Group2-1455467091: created successfully Jul 22 01:58:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-555dc089-846a-4c3e-84c5-d8b5dacac74e tempest-GroupsTest-196943186 None] Create group completed successfully. Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Acquiring lock "cinder-5934c8fc-35a2-4199-b8a1-bc7e96cc137c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "cinder-5934c8fc-35a2-4199-b8a1-bc7e96cc137c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Acquiring lock "cinder-quobyte-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "cinder-quobyte-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d6e72-e78b-4223-b7ec-87baba655932]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:51 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c Jul 22 01:58:51 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:51 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" returned: 0 in 0.366s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:51 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c Jul 22 01:58:51 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:52 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "cinder-quobyte-5934c8fc-35a2-4199-b8a1-bc7e96cc137c" released by "delete_volume" :: held 0.662s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Created reservations ['1e399fb3-5000-4102-a328-2e05e97e604a', '755e3962-b3cf-428f-853a-75f412003f24', 'a7da7905-d5ca-4efe-8c09-6850968e3f2c', 'f18c0c06-c9af-4c90-8567-01f1f83b4204'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:52 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:52 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:52 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.281s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:52 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:52 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Deleted volume successfully. Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-161a30cd-b83a-49b1-8b46-b332ef2ea9b7 tempest-VolumesMetadataTest-725214954 None] Lock "cinder-5934c8fc-35a2-4199-b8a1-bc7e96cc137c-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:52 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:58:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (cf81a2c1-0463-4808-ac9c-ad20e3ff947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cb754a-16af-4f90-892d-778be5cc0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cb754a-16af-4f90-892d-778be5cc0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1997857217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfab125-cc34-4a41-bbd2-7bbf61a7da8f,host='devstack@QuobyteHD#QuobyteHD',id=0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:53Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ffbc160-a114-4ec3-b5c4-de133c6c7afc),volume_type_id=8ffbc160-a114-4ec3-b5c4-de133c6c7afc)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b45ad15-618d-46b2-a91f-935a4c3c2f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b45ad15-618d-46b2-a91f-935a4c3c2f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711826f-7786-4918-9358-118eff054c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1711826f-7786-4918-9358-118eff054c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a', 'volume_name': 'volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1b3c3-b6b5-4151-8e57-6798f20a4bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf1b3c3-b6b5-4151-8e57-6798f20a4bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143c1092-78f0-4b06-b5ea-576eb7158b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Volume 0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a', 'volume_size': 1} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bfab125-cc34-4a41-bbd2-7bbf61a7da8f,created_at=2026-07-21T23:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1997857217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfab125-cc34-4a41-bbd2-7bbf61a7da8f,host='devstack@QuobyteHD#QuobyteHD',id=0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:53Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ffbc160-a114-4ec3-b5c4-de133c6c7afc),volume_type_id=8ffbc160-a114-4ec3-b5c4-de133c6c7afc)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Creating volume 0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:53 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:53 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a 1073741824 Jul 22 01:58:53 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:53 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a 1073741824" returned: 0 in 0.565s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:53 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a Jul 22 01:58:53 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:54 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" returned: 0 in 0.283s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143c1092-78f0-4b06-b5ea-576eb7158b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d161a5-307b-4810-8c8d-7bc5bed775c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:54 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Volume volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a (0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a): created successfully Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d161a5-307b-4810-8c8d-7bc5bed775c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (cf81a2c1-0463-4808-ac9c-ad20e3ff947c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fb751a1f-2303-4e48-83c2-aed6a38cdfd8 tempest-GroupsTest-196943186 None] Created volume successfully. Jul 22 01:58:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Acquiring lock "cinder-quobyte-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:58:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" acquired by "delete_volume" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:58:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e630b2-1b06-4cdb-80c0-7346d63c94b5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:58:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:56 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a Jul 22 01:58:56 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:57 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" returned: 0 in 0.586s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:57 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a Jul 22 01:58:57 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:57 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" returned: 0 in 0.335s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-0ea42e19-3d92-4fe3-ac41-2a0aa8802b6a" released by "delete_volume" :: held 0.999s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Created reservations ['7d2b919f-9d8f-4a5e-b806-687bad9cee78'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:57 devstack cinder-volume[87153]: WARNING cinder.quota [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1851108955 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1851108955, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:57 devstack cinder-volume[87153]: WARNING cinder.quota [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1851108955 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1851108955, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Created reservations ['76a362ba-4675-4dda-b348-4c370010ae01', '2738c0c6-ee4b-4ef8-ac74-f23b170e6309', 'd16f60b9-c09c-4b6e-b36e-ee6d897deaa4', '4f858ec0-005c-4cb4-b9f5-cef00fc0dd27'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:57 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:57 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Created reservations ['ff12884c-3470-4fd5-8855-65339f01694d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:58 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.342s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-366cb15f-8fc5-47cc-a7f7-12162dcb11f4 tempest-GroupsTest-196943186 None] Delete group completed successfully. Jul 22 01:58:58 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:58:58 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:58 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.424s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:58:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-320a609c-2507-4587-916e-ac6742bad105 tempest-GroupsTest-196943186 None] Delete group completed successfully. Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Flow 'volume_create_manager' (b8a972d9-d51c-4f5b-bd53-5fbe3edba2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbae598-0597-4082-a9ab-20fd71159bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbae598-0597-4082-a9ab-20fd71159bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-988672360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33463308-ae2f-4c1f-9dbf-ddf74693291a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bdb5172e448b19241d9d05d84799f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:59Z,use_quota=True,user_id='c684cfc784664f17855fcceaf2559201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1cff6d-4c3f-4956-b2a7-d609d26f4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1cff6d-4c3f-4956-b2a7-d609d26f4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5581612-1f2c-46a9-9da9-273a2361efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5581612-1f2c-46a9-9da9-273a2361efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33463308-ae2f-4c1f-9dbf-ddf74693291a', 'volume_name': 'volume-33463308-ae2f-4c1f-9dbf-ddf74693291a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca8353d-92a3-4ee0-ba8d-b86a73743c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca8353d-92a3-4ee0-ba8d-b86a73743c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580090e7-c5fc-401c-9435-e95415c28d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:58:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Volume 33463308-ae2f-4c1f-9dbf-ddf74693291a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33463308-ae2f-4c1f-9dbf-ddf74693291a', 'volume_size': 1} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-988672360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33463308-ae2f-4c1f-9dbf-ddf74693291a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bdb5172e448b19241d9d05d84799f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:58:59Z,use_quota=True,user_id='c684cfc784664f17855fcceaf2559201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Creating volume 33463308-ae2f-4c1f-9dbf-ddf74693291a {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:58:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:58:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:59 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a 1073741824 Jul 22 01:58:59 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:59 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a 1073741824" returned: 0 in 0.558s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:58:59 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a Jul 22 01:58:59 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:58:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9f9f337c-c64f-4a31-a09e-96e2513f7960 tempest-GroupsTest-196943186 None] Group tempest-GroupsTest-Group-297592466: creating Jul 22 01:58:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9f9f337c-c64f-4a31-a09e-96e2513f7960 tempest-GroupsTest-196943186 None] Group tempest-GroupsTest-Group-297592466: created successfully Jul 22 01:58:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9f9f337c-c64f-4a31-a09e-96e2513f7960 tempest-GroupsTest-196943186 None] Create group completed successfully. Jul 22 01:58:59 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a" returned: 0 in 0.385s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580090e7-c5fc-401c-9435-e95415c28d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33463308-ae2f-4c1f-9dbf-ddf74693291a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:58:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c287546f-c715-4105-9c19-6167e3344d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Volume volume-33463308-ae2f-4c1f-9dbf-ddf74693291a (33463308-ae2f-4c1f-9dbf-ddf74693291a): created successfully Jul 22 01:59:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c287546f-c715-4105-9c19-6167e3344d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Flow 'volume_create_manager' (b8a972d9-d51c-4f5b-bd53-5fbe3edba2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-45066c3a-7ff6-4c64-b35c-ff53aadf81c7 tempest-VolumesTransfersV355Test-1220078403 None] Created volume successfully. Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (1d5a0660-7698-4579-837f-f12005b2b864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516dc8e4-0bcc-45e5-a38d-fcdc06d3cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516dc8e4-0bcc-45e5-a38d-fcdc06d3cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580435182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,host='devstack@QuobyteHD#QuobyteHD',id=9ad4db05-16c1-4eff-a2bd-6e9eba129163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:02Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba5d674f-7f72-4dda-93d4-16b5eeebf1d6),volume_type_id=ba5d674f-7f72-4dda-93d4-16b5eeebf1d6)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0847a5b2-034b-4436-a5b1-c0339f17fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0847a5b2-034b-4436-a5b1-c0339f17fb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad840c9-a262-4fcb-9b86-1b72a26d5cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad840c9-a262-4fcb-9b86-1b72a26d5cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad4db05-16c1-4eff-a2bd-6e9eba129163', 'volume_name': 'volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704688ff-c94a-4b1f-add8-0d32ef4993c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704688ff-c94a-4b1f-add8-0d32ef4993c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c646d2-739d-4a3c-80fd-2e56bb1c2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Volume 9ad4db05-16c1-4eff-a2bd-6e9eba129163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163', 'volume_size': 1} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,created_at=2026-07-21T23:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580435182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,host='devstack@QuobyteHD#QuobyteHD',id=9ad4db05-16c1-4eff-a2bd-6e9eba129163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:02Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba5d674f-7f72-4dda-93d4-16b5eeebf1d6),volume_type_id=ba5d674f-7f72-4dda-93d4-16b5eeebf1d6)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Creating volume 9ad4db05-16c1-4eff-a2bd-6e9eba129163 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:01 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:01 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 1073741824 Jul 22 01:59:01 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-38a536a1-9cbf-4ec3-b95c-8036ee638930 tempest-VolumesTransfersV355Test-1759478504 None] Transfer volume completed successfully. Jul 22 01:59:02 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 1073741824" returned: 0 in 0.911s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:02 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 Jul 22 01:59:02 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:03 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163" returned: 0 in 0.408s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c646d2-739d-4a3c-80fd-2e56bb1c2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b622804-942d-4dfa-8a26-91b744b686b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:03 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Volume volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 (9ad4db05-16c1-4eff-a2bd-6e9eba129163): created successfully Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b622804-942d-4dfa-8a26-91b744b686b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (1d5a0660-7698-4579-837f-f12005b2b864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "cinder-33463308-ae2f-4c1f-9dbf-ddf74693291a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7ea14429-9dbf-464c-86cf-cab873acc6d2 tempest-GroupsTest-196943186 None] Created volume successfully. Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-33463308-ae2f-4c1f-9dbf-ddf74693291a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "cinder-quobyte-33463308-ae2f-4c1f-9dbf-ddf74693291a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-quobyte-33463308-ae2f-4c1f-9dbf-ddf74693291a" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d6550-84b0-49b2-a94e-6be0b1f46b2d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:03 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a Jul 22 01:59:03 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:04 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a" returned: 0 in 0.425s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:04 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a Jul 22 01:59:04 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:04 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33463308-ae2f-4c1f-9dbf-ddf74693291a" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-quobyte-33463308-ae2f-4c1f-9dbf-ddf74693291a" released by "delete_volume" :: held 0.759s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Created reservations ['8e6ca197-fa1e-4a42-b572-6b5eea696391', '3ed62598-d80e-4a4f-82c9-07e3996d927b', '9b7af483-4627-4969-9ab9-5f78762c6ca0', '3702a68d-a194-4473-83da-fb9484ec8498'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:04 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:04 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:04 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.416s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Deleted volume successfully. Jul 22 01:59:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-75d23458-26d0-4450-b557-5ce239fde24c tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-33463308-ae2f-4c1f-9dbf-ddf74693291a-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (7e7fbde9-fb8f-4c23-a27e-31cdfd58dcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9713b-3217-4e62-ad59-f6e9d47ed02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d9713b-3217-4e62-ad59-f6e9d47ed02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519528033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,host='devstack@QuobyteHD#QuobyteHD',id=948a93e7-d1b2-49a1-98b3-20f0c593a827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:05Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba5d674f-7f72-4dda-93d4-16b5eeebf1d6),volume_type_id=ba5d674f-7f72-4dda-93d4-16b5eeebf1d6)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e53b6a2-2df0-4187-b0ea-d85f116b7b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e53b6a2-2df0-4187-b0ea-d85f116b7b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08dcb756-b1c9-40a3-b700-466d1fc2fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08dcb756-b1c9-40a3-b700-466d1fc2fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948a93e7-d1b2-49a1-98b3-20f0c593a827', 'volume_name': 'volume-948a93e7-d1b2-49a1-98b3-20f0c593a827', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef622c3-8e0e-4e50-ac30-06b3cb5884c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef622c3-8e0e-4e50-ac30-06b3cb5884c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac87bc4-3565-4fc5-999f-e219fb5f0551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Volume 948a93e7-d1b2-49a1-98b3-20f0c593a827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948a93e7-d1b2-49a1-98b3-20f0c593a827', 'volume_size': 1} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,created_at=2026-07-21T23:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519528033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8274bbb6-fefa-4ee3-b0b9-6ab638abb438,host='devstack@QuobyteHD#QuobyteHD',id=948a93e7-d1b2-49a1-98b3-20f0c593a827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d8d9afb8a34e7db896bb302982fe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:05Z,use_quota=True,user_id='1855d9d731df4a00a68c7a1df2baa90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba5d674f-7f72-4dda-93d4-16b5eeebf1d6),volume_type_id=ba5d674f-7f72-4dda-93d4-16b5eeebf1d6)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Creating volume 948a93e7-d1b2-49a1-98b3-20f0c593a827 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:05 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:05 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 1073741824 Jul 22 01:59:05 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Flow 'volume_create_manager' (0472783b-a6ce-421b-82c2-55809371c102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc917877-98d2-4c8d-bf1b-b511b58181c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc917877-98d2-4c8d-bf1b-b511b58181c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-966815148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89024cab-2d78-406c-adc3-7099f515414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bdb5172e448b19241d9d05d84799f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:05Z,use_quota=True,user_id='c684cfc784664f17855fcceaf2559201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4952849-83a1-4720-9119-25844d299a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4952849-83a1-4720-9119-25844d299a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11310546-46f6-4f95-80d9-36e5784a83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11310546-46f6-4f95-80d9-36e5784a83a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89024cab-2d78-406c-adc3-7099f515414b', 'volume_name': 'volume-89024cab-2d78-406c-adc3-7099f515414b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67662b91-4776-47bc-9b59-e2287a930927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67662b91-4776-47bc-9b59-e2287a930927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6998f5-ed3d-4971-ba60-8984b81bcfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:05 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Volume 89024cab-2d78-406c-adc3-7099f515414b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89024cab-2d78-406c-adc3-7099f515414b', 'volume_size': 1} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:05 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 1073741824" returned: 0 in 0.634s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:05 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 Jul 22 01:59:05 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:06 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827" returned: 0 in 0.271s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-966815148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89024cab-2d78-406c-adc3-7099f515414b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40bdb5172e448b19241d9d05d84799f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:05Z,use_quota=True,user_id='c684cfc784664f17855fcceaf2559201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Creating volume 89024cab-2d78-406c-adc3-7099f515414b {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac87bc4-3565-4fc5-999f-e219fb5f0551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948a93e7-d1b2-49a1-98b3-20f0c593a827', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eead99-4f4c-409c-95bb-2021bcb74101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:06 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b 1073741824 Jul 22 01:59:06 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Volume volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 (948a93e7-d1b2-49a1-98b3-20f0c593a827): created successfully Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eead99-4f4c-409c-95bb-2021bcb74101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Flow 'volume_create_manager' (7e7fbde9-fb8f-4c23-a27e-31cdfd58dcf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4a66fa09-3853-4c15-8527-5b150a26f882 tempest-GroupsTest-196943186 None] Created volume successfully. Jul 22 01:59:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4e30d496-077d-4eda-a993-21807ce389d2 tempest-GroupsTest-196943186 None] Update group completed successfully. Jul 22 01:59:06 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b 1073741824" returned: 0 in 0.638s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-8d443664-8eae-4186-b336-110435575c0b req-45f9b80c-5a85-4f32-8cd3-871ea7a88a53 tempest-AttachVolumeNegativeTest-739521749 None] Terminate volume connection completed successfully. Jul 22 01:59:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-8d443664-8eae-4186-b336-110435575c0b req-45f9b80c-5a85-4f32-8cd3-871ea7a88a53 tempest-AttachVolumeNegativeTest-739521749 None] Deleting attachment 5eb4b972-7149-480e-8693-685073b02342. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 01:59:06 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b Jul 22 01:59:06 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:07 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b" returned: 0 in 0.325s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6998f5-ed3d-4971-ba60-8984b81bcfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89024cab-2d78-406c-adc3-7099f515414b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed8b78f-2bdf-4f6e-8fcb-7aa00283102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Volume volume-89024cab-2d78-406c-adc3-7099f515414b (89024cab-2d78-406c-adc3-7099f515414b): created successfully Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed8b78f-2bdf-4f6e-8fcb-7aa00283102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Flow 'volume_create_manager' (0472783b-a6ce-421b-82c2-55809371c102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f6215c32-2fc0-4535-8b28-4b84ff3ff0b8 tempest-VolumesTransfersV355Test-1220078403 None] Created volume successfully. Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "cinder-89024cab-2d78-406c-adc3-7099f515414b-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-89024cab-2d78-406c-adc3-7099f515414b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "cinder-quobyte-89024cab-2d78-406c-adc3-7099f515414b" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-quobyte-89024cab-2d78-406c-adc3-7099f515414b" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2a4098-196a-45a7-93df-ac49eed38256]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:08 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b Jul 22 01:59:08 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b92cb749-e858-46a3-af6f-bcb71fd185cd tempest-GroupsTest-196943186 None] Update group completed successfully. Jul 22 01:59:08 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b" returned: 0 in 0.590s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:08 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b Jul 22 01:59:08 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:09 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89024cab-2d78-406c-adc3-7099f515414b" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-quobyte-89024cab-2d78-406c-adc3-7099f515414b" released by "delete_volume" :: held 1.080s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Created reservations ['51071bbf-e41e-4656-a9f8-7162eaf59603', '7f77eed6-f102-4b31-a97d-ad312a2ef6e3', 'a59b54bf-ff87-401f-8ef8-4d11ef9cb02e', '23f58263-288e-4896-959c-02843083a57a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:09 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:09 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:09 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.281s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Deleted volume successfully. Jul 22 01:59:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e1a38ad7-cd7e-4cbd-a8c6-91e2a1a0b2cb tempest-VolumesTransfersV355Test-201456863 None] Lock "cinder-89024cab-2d78-406c-adc3-7099f515414b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Acquiring lock "cinder-quobyte-948a93e7-d1b2-49a1-98b3-20f0c593a827" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-948a93e7-d1b2-49a1-98b3-20f0c593a827" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577973f-386a-4173-bf10-207ac641d6c6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:10 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 Jul 22 01:59:10 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:10 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:10 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827 Jul 22 01:59:10 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:11 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-948a93e7-d1b2-49a1-98b3-20f0c593a827" returned: 0 in 0.489s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-948a93e7-d1b2-49a1-98b3-20f0c593a827" released by "delete_volume" :: held 1.056s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Acquiring lock "cinder-quobyte-9ad4db05-16c1-4eff-a2bd-6e9eba129163" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-9ad4db05-16c1-4eff-a2bd-6e9eba129163" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[098fbab3-5b70-424e-85d3-e83832ff5453]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:11 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 Jul 22 01:59:11 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:11 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163" returned: 0 in 0.754s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:11 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163 Jul 22 01:59:11 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:12 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ad4db05-16c1-4eff-a2bd-6e9eba129163" returned: 0 in 0.488s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "cinder-quobyte-9ad4db05-16c1-4eff-a2bd-6e9eba129163" released by "delete_volume" :: held 1.299s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Created reservations ['9b30433f-2029-43fa-8460-229afdef8dcc'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:12 devstack cinder-volume[87153]: WARNING cinder.quota [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1462541803 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1462541803, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:59:12 devstack cinder-volume[87153]: WARNING cinder.quota [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1462541803 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1462541803, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Created reservations ['acad1c7b-92fe-48ba-9c37-1564b43eaeec', '84e8b78f-15a8-4ab6-9a0c-9c6f44f55724', '506507f3-c09f-4875-872c-ff3f8dbf2602', '56a4973a-0b99-419c-bc5b-e36fb728c8c6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Created reservations ['2362b07a-a04d-40e3-8006-8825ec4febee', '6fff417a-b6d8-4ac4-8d93-79ab99868f70', '7f0aae63-5d3b-47d4-8536-4350f79d1d65', '934bd697-2ba7-47fa-af98-89d953320736'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:13 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:13 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:13 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.334s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-951bb47e-639b-4919-bf0e-dfbfe4f16f48 tempest-GroupsTest-196943186 None] Delete group completed successfully. Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Flow 'volume_create_manager' (4b4e719c-deb3-4153-a1f8-92aba978ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f35b049-e6c1-4c16-a669-330fb9703c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f35b049-e6c1-4c16-a669-330fb9703c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1763225840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8dc689-6bec-46b8-8758-30c09f02bbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1cec68d8bf4914b93b8cd37d195917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:16Z,use_quota=True,user_id='d9654d7e45d74cd1812992b0960c827a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce34e921-add9-48fb-a875-ce6178eb0456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce34e921-add9-48fb-a875-ce6178eb0456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb30bc31-1196-4344-ad07-228e6599ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb30bc31-1196-4344-ad07-228e6599ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8dc689-6bec-46b8-8758-30c09f02bbb3', 'volume_name': 'volume-da8dc689-6bec-46b8-8758-30c09f02bbb3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a50db6d-6a6d-4d19-988e-a6dff82a2ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a50db6d-6a6d-4d19-988e-a6dff82a2ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdc4d3a-b6ae-4b6f-a295-fc6045644f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume da8dc689-6bec-46b8-8758-30c09f02bbb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8dc689-6bec-46b8-8758-30c09f02bbb3', 'volume_size': 1} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1763225840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8dc689-6bec-46b8-8758-30c09f02bbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1cec68d8bf4914b93b8cd37d195917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:16Z,use_quota=True,user_id='d9654d7e45d74cd1812992b0960c827a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Creating volume da8dc689-6bec-46b8-8758-30c09f02bbb3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:16 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:16 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 1073741824 Jul 22 01:59:16 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Flow 'volume_create_manager' (d8c06ca1-290a-4355-ad56-ee6f413f81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b97e6a-8d12-4bad-91da-7f689fcc1ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b97e6a-8d12-4bad-91da-7f689fcc1ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-702428874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e6238a-84c2-4459-aa55-f2af52b068f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1cec68d8bf4914b93b8cd37d195917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:17Z,use_quota=True,user_id='d9654d7e45d74cd1812992b0960c827a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba5b629-3a71-4bca-8a9b-ec47e7388dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba5b629-3a71-4bca-8a9b-ec47e7388dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd7d63-9d2e-42ba-9206-1ee58e9df329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecd7d63-9d2e-42ba-9206-1ee58e9df329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e6238a-84c2-4459-aa55-f2af52b068f8', 'volume_name': 'volume-f3e6238a-84c2-4459-aa55-f2af52b068f8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab187f6-f385-4ff8-aab8-fcbe1eb5b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab187f6-f385-4ff8-aab8-fcbe1eb5b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99be687-44f2-4046-b01e-3ec3061149ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume f3e6238a-84c2-4459-aa55-f2af52b068f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e6238a-84c2-4459-aa55-f2af52b068f8', 'volume_size': 1} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:16 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 1073741824" returned: 0 in 0.768s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:16 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 Jul 22 01:59:16 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:17 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3" returned: 0 in 0.289s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-702428874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e6238a-84c2-4459-aa55-f2af52b068f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1cec68d8bf4914b93b8cd37d195917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:17Z,use_quota=True,user_id='d9654d7e45d74cd1812992b0960c827a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Creating volume f3e6238a-84c2-4459-aa55-f2af52b068f8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:17 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdc4d3a-b6ae-4b6f-a295-fc6045644f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8dc689-6bec-46b8-8758-30c09f02bbb3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfa46ae-e2ad-4c78-afd0-04a5100bf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:17 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 1073741824 Jul 22 01:59:17 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 (da8dc689-6bec-46b8-8758-30c09f02bbb3): created successfully Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfa46ae-e2ad-4c78-afd0-04a5100bf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Flow 'volume_create_manager' (4b4e719c-deb3-4153-a1f8-92aba978ba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1361fc34-2be1-4f0e-a826-c9f3a3fd4339 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Created volume successfully. Jul 22 01:59:17 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 1073741824" returned: 0 in 0.646s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:17 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 Jul 22 01:59:17 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:18 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99be687-44f2-4046-b01e-3ec3061149ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e6238a-84c2-4459-aa55-f2af52b068f8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00b30fc-3edb-4dd8-82cb-481fb0abf730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Volume volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 (f3e6238a-84c2-4459-aa55-f2af52b068f8): created successfully Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00b30fc-3edb-4dd8-82cb-481fb0abf730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Flow 'volume_create_manager' (d8c06ca1-290a-4355-ad56-ee6f413f81e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4965bc29-9d53-4d20-9c53-e2f7e0fc9b07 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Created volume successfully. Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Flow 'volume_create_manager' (626222ad-8d3c-4907-a0c2-4edb65822d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1893373c-6244-4bdd-8c1c-0aaf7b15b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1893373c-6244-4bdd-8c1c-0aaf7b15b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1230637211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e9241-6d55-4bf4-b1da-2dcb523cda27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e16f639fec450fb522092120c24d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:21Z,use_quota=True,user_id='a4db4a88c00c4f42865211575d8ce693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd9b15c-d1d4-4e1d-8d1f-6c350f230072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd9b15c-d1d4-4e1d-8d1f-6c350f230072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e70fdd-3ed9-4d47-ab50-e0c6ee6c7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e70fdd-3ed9-4d47-ab50-e0c6ee6c7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1e9241-6d55-4bf4-b1da-2dcb523cda27', 'volume_name': 'volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e7fbcb-1fa9-4d3e-a76e-c0633d5d5325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e7fbcb-1fa9-4d3e-a76e-c0633d5d5325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6766adb8-dcf9-4590-bb52-855360f89f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:21 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Volume 3b1e9241-6d55-4bf4-b1da-2dcb523cda27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27', 'volume_size': 1} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1230637211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e9241-6d55-4bf4-b1da-2dcb523cda27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e16f639fec450fb522092120c24d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:21Z,use_quota=True,user_id='a4db4a88c00c4f42865211575d8ce693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Creating volume 3b1e9241-6d55-4bf4-b1da-2dcb523cda27 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:21 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:21 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 1073741824 Jul 22 01:59:21 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:22 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 1073741824" returned: 0 in 0.743s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:22 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 Jul 22 01:59:22 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:22 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" returned: 0 in 0.382s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6766adb8-dcf9-4590-bb52-855360f89f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95060199-c91e-4a2c-bbc1-9406e5c28bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Volume volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 (3b1e9241-6d55-4bf4-b1da-2dcb523cda27): created successfully Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95060199-c91e-4a2c-bbc1-9406e5c28bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Flow 'volume_create_manager' (626222ad-8d3c-4907-a0c2-4edb65822d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:22 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-14ebe179-05da-4ffa-b93b-53a0eaff74f3 tempest-VolumesTransfersV357Test-1273566325 None] Created volume successfully. Jul 22 01:59:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-43748322-7828-4c1a-9b8d-153b16245dd4 tempest-GroupsV314Test-592002924 None] Group tempest-GroupsV314Test-Group-1418276551: creating Jul 22 01:59:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-43748322-7828-4c1a-9b8d-153b16245dd4 tempest-GroupsV314Test-592002924 None] Group tempest-GroupsV314Test-Group-1418276551: created successfully Jul 22 01:59:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-43748322-7828-4c1a-9b8d-153b16245dd4 tempest-GroupsV314Test-592002924 None] Create group completed successfully. Jul 22 01:59:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3b678157-c1e1-4af7-a5f4-1b18e9f61b54 tempest-VolumesTransfersV357Test-319412726 None] Transfer volume completed successfully. Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "cinder-3b1e9241-6d55-4bf4-b1da-2dcb523cda27-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-3b1e9241-6d55-4bf4-b1da-2dcb523cda27-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "cinder-quobyte-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-quobyte-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd3249-7fdb-4acd-b653-cb389a109c74]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:25 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 Jul 22 01:59:25 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Flow 'volume_create_manager' (f554cf35-74a1-46a8-ac34-08837710e0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73772e1a-83f3-4aef-bb6e-a0e042f401a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73772e1a-83f3-4aef-bb6e-a0e042f401a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866053943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=968e2a8b-93bc-40ed-95ee-2fcd22f76696,host='devstack@QuobyteHD#QuobyteHD',id=997ba258-6b1c-4242-89c1-0e2a56ddd8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc749a3f1efc4e4cbe0941725210bdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:26Z,use_quota=True,user_id='0666be3e5ae047c18a4324be9a52ff1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e431375-4e20-4816-ab3d-e5c7ed169f67),volume_type_id=5e431375-4e20-4816-ab3d-e5c7ed169f67)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95eba0a-eb0f-42fe-8d02-a5f9eeae901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95eba0a-eb0f-42fe-8d02-a5f9eeae901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb348ad-60a2-42cb-b21a-bff531b1247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb348ad-60a2-42cb-b21a-bff531b1247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997ba258-6b1c-4242-89c1-0e2a56ddd8df', 'volume_name': 'volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82b0d8-1c89-485a-a2a1-9d1550e2a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82b0d8-1c89-485a-a2a1-9d1550e2a47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6632af98-f84a-4161-8a11-c3a6ea2a0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Volume 997ba258-6b1c-4242-89c1-0e2a56ddd8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df', 'volume_size': 1} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=968e2a8b-93bc-40ed-95ee-2fcd22f76696,created_at=2026-07-21T23:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1866053943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=968e2a8b-93bc-40ed-95ee-2fcd22f76696,host='devstack@QuobyteHD#QuobyteHD',id=997ba258-6b1c-4242-89c1-0e2a56ddd8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc749a3f1efc4e4cbe0941725210bdd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:26Z,use_quota=True,user_id='0666be3e5ae047c18a4324be9a52ff1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e431375-4e20-4816-ab3d-e5c7ed169f67),volume_type_id=5e431375-4e20-4816-ab3d-e5c7ed169f67)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Creating volume 997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:26 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" returned: 0 in 0.716s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:26 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df 1073741824 Jul 22 01:59:26 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:26 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27 Jul 22 01:59:26 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:26 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" returned: 0 in 0.458s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-quobyte-3b1e9241-6d55-4bf4-b1da-2dcb523cda27" released by "delete_volume" :: held 1.234s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Created reservations ['261ab6e4-bfa9-41fd-a899-6fc25b266e85', '2af9036e-42ac-4dc1-849a-c3b64b92bc25', 'd692869c-b4ca-4d87-aafc-85340883b88b', 'c71e7555-a2c0-4bd3-ac3f-d8619ddb376a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:26 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df 1073741824" returned: 0 in 0.681s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:26 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:26 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:27 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:27 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:27 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Deleted volume successfully. Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-36029e34-552c-4123-bf8f-a4762b1500e1 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-3b1e9241-6d55-4bf4-b1da-2dcb523cda27-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:27 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.413s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6632af98-f84a-4161-8a11-c3a6ea2a0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2c01ec-74dc-4f44-9a2b-ca3767bb7be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Volume volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df (997ba258-6b1c-4242-89c1-0e2a56ddd8df): created successfully Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2c01ec-74dc-4f44-9a2b-ca3767bb7be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Flow 'volume_create_manager' (f554cf35-74a1-46a8-ac34-08837710e0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3ee9a964-9c9b-4cdc-a129-1ff757ba794f tempest-GroupsV314Test-592002924 None] Created volume successfully. Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Flow 'volume_create_manager' (5ec94ca0-0f88-4f48-8e03-39f49df25fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3850da84-8264-434f-9e0d-6c889ba721e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3850da84-8264-434f-9e0d-6c889ba721e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054831582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72755877-f8d3-4c57-b1f9-8deba4da729d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e16f639fec450fb522092120c24d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:29Z,use_quota=True,user_id='a4db4a88c00c4f42865211575d8ce693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bafb53-0d4a-49ae-912e-60bb325ed601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bafb53-0d4a-49ae-912e-60bb325ed601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bac2979-fa75-495d-8a4f-5e97110eefe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bac2979-fa75-495d-8a4f-5e97110eefe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72755877-f8d3-4c57-b1f9-8deba4da729d', 'volume_name': 'volume-72755877-f8d3-4c57-b1f9-8deba4da729d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f67e38-50c2-461c-a017-f9113dd7ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f67e38-50c2-461c-a017-f9113dd7ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96496557-13d9-4290-8cf6-e087b212be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:29 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Volume 72755877-f8d3-4c57-b1f9-8deba4da729d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72755877-f8d3-4c57-b1f9-8deba4da729d', 'volume_size': 1} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054831582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72755877-f8d3-4c57-b1f9-8deba4da729d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84e16f639fec450fb522092120c24d34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:29Z,use_quota=True,user_id='a4db4a88c00c4f42865211575d8ce693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Creating volume 72755877-f8d3-4c57-b1f9-8deba4da729d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:29 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:29 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d 1073741824 Jul 22 01:59:29 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:30 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d 1073741824" returned: 0 in 1.035s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:30 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d Jul 22 01:59:30 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:30 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d" returned: 0 in 0.360s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.426s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:30 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Cloning volume 997ba258-6b1c-4242-89c1-0e2a56ddd8df to volume fd02df72-6c6b-4577-b3bd-69c4833d11f5 Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96496557-13d9-4290-8cf6-e087b212be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72755877-f8d3-4c57-b1f9-8deba4da729d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e355940-ac0e-447f-af77-c5afc4717a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:31 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Volume volume-72755877-f8d3-4c57-b1f9-8deba4da729d (72755877-f8d3-4c57-b1f9-8deba4da729d): created successfully Jul 22 01:59:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e355940-ac0e-447f-af77-c5afc4717a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Flow 'volume_create_manager' (5ec94ca0-0f88-4f48-8e03-39f49df25fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Creating offline snapshot 7bb91222-55bb-41a7-be10-3da70dac0801 of volume 997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 01:59:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0a455603-129e-4b03-a052-1eda15480780 tempest-VolumesTransfersV357Test-1273566325 None] Created volume successfully. Jul 22 01:59:31 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82f146-2fe9-4c9e-bb79-22be66e12e3e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:31 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:31 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "cinder-72755877-f8d3-4c57-b1f9-8deba4da729d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-72755877-f8d3-4c57-b1f9-8deba4da729d-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:32 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 1.209s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:32 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 1G Jul 22 01:59:32 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "cinder-quobyte-72755877-f8d3-4c57-b1f9-8deba4da729d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-quobyte-72755877-f8d3-4c57-b1f9-8deba4da729d" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8b0a9-3f6b-419c-b1c8-b9643437d523]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:32 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d Jul 22 01:59:32 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:33 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d" returned: 0 in 0.733s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:33 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 1G" returned: 0 in 0.978s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:33 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d Jul 22 01:59:33 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:33 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:33 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:33 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-72755877-f8d3-4c57-b1f9-8deba4da729d" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-quobyte-72755877-f8d3-4c57-b1f9-8deba4da729d" released by "delete_volume" :: held 1.305s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:33 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Created reservations ['3bd62d46-ab1e-4a92-9d14-38ac320c20d5', 'fbeda987-b115-4849-97d9-cba729774da8', 'fb2402cf-0d6b-4c2e-bc7c-5f9cc457cd6c', '0ebf7ff3-4c15-49fa-ab36-7e5e863e7093'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:34 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.709s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:34 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:34 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:34 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:34 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:34 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:34 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.385s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:34 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info Jul 22 01:59:34 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:34 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.611s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Deleted volume successfully. Jul 22 01:59:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-31afdb8e-6259-40cc-b468-7f8daf779ea7 tempest-VolumesTransfersV357Test-1416778435 None] Lock "cinder-72755877-f8d3-4c57-b1f9-8deba4da729d-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:35 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info" returned: 0 in 0.518s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:35 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:35 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info Jul 22 01:59:35 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:35 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.info" returned: 0 in 0.433s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Acquiring lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] snapshot: 7bb91222-55bb-41a7-be10-3da70dac0801, volume: fd02df72-6c6b-4577-b3bd-69c4833d11f5, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b178e-da14-41e9-8af9-b9e6cde19c28]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:35 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:35 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:36 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.728s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba46b2c-1988-4829-9a4c-fc8a322af353]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:36 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:36 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:37 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.892s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:37 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 01:59:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:37 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 Jul 22 01:59:37 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:44 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=120,cinder:SELECT=123,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:59:44 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=140,cinder:DELETE=6 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 01:59:45 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5" returned: 0 in 8.576s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:45 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d440c-d5a6-427d-aa4a-4329db93e65f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:46 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:46 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:46 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.613s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 01:59:46 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Converted 1024.00 MB image at 119.37 MB/s Jul 22 01:59:46 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 is being set with open permissions: ugo+rw: NotImplementedError Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:46 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 Jul 22 01:59:46 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:46 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5" returned: 0 in 0.269s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" released by "_copy_volume_from_snapshot" :: held 11.247s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Acquiring lock "cinder-quobyte-7bb91222-55bb-41a7-be10-3da70dac0801" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-7bb91222-55bb-41a7-be10-3da70dac0801" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Deleting offline snapshot 7bb91222-55bb-41a7-be10-3da70dac0801 of volume 997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] snapshot_file for this snap is: volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d93e2f6-ea0c-4e41-a7fb-9faeda9139ac]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:47 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:47 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:47 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.420s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b53e1b-5462-4164-be00-1dbdff27db6d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:47 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:47 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:47 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:47 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:47 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:48 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:48 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801 Jul 22 01:59:48 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:48 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df.7bb91222-55bb-41a7-be10-3da70dac0801" returned: 0 in 0.264s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-7bb91222-55bb-41a7-be10-3da70dac0801" released by "_delete_snapshot" :: held 1.617s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.667s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0ef50674-bffa-496a-b35e-def0832dfc80 tempest-GroupsV314Test-592002924 None] Create group from source-group-968e2a8b-93bc-40ed-95ee-2fcd22f76696 completed successfully. Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Flow 'volume_create_manager' (77ca7c01-e993-4207-a37c-75223ef3d799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6690123-b67f-4b09-9257-9431dffb7b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6690123-b67f-4b09-9257-9431dffb7b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1306208650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da88d93c50541cea5810e12519d0ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:49Z,use_quota=True,user_id='603e8c2fb17649a0a30354eebf2b8ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292cbbc-98f6-4c8d-9123-24416c074ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292cbbc-98f6-4c8d-9123-24416c074ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b580400-8999-47f2-b4f5-9d0f5f9fe937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b580400-8999-47f2-b4f5-9d0f5f9fe937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f', 'volume_name': 'volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f', 'volume_size': 2}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c09365a-0ef7-43c0-bab0-c9cede59e087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c09365a-0ef7-43c0-bab0-c9cede59e087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf09ba0-2921-45fb-bb82-137a2dad3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Volume 3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f', 'volume_size': 2} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1306208650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da88d93c50541cea5810e12519d0ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:49Z,use_quota=True,user_id='603e8c2fb17649a0a30354eebf2b8ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Creating volume 3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f 2147483648 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:48 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f 2147483648 Jul 22 01:59:48 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:49 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f 2147483648" returned: 0 in 0.470s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:49 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f Jul 22 01:59:49 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:49 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf09ba0-2921-45fb-bb82-137a2dad3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f', 'volume_size': 2}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd57f80-5737-4ea2-acf4-db39697b99e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:49 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Volume volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f (3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f): created successfully Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd57f80-5737-4ea2-acf4-db39697b99e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Flow 'volume_create_manager' (77ca7c01-e993-4207-a37c-75223ef3d799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-78ac15a3-0094-483b-97ea-3aa488f94914 tempest-VolumesCloneNegativeTest-1761476625 None] Created volume successfully. Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Acquiring lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[34806206-b5be-4618-a058-de1c21813a6e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Acquiring lock "cinder-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:50 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 Jul 22 01:59:50 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "cinder-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Acquiring lock "cinder-quobyte-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "cinder-quobyte-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3fe63b-3c1e-4763-a41a-6874a2d4893f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:50 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f Jul 22 01:59:50 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:50 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:50 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5 Jul 22 01:59:50 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:50 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:50 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f Jul 22 01:59:50 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:50 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fd02df72-6c6b-4577-b3bd-69c4833d11f5" returned: 0 in 0.283s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-fd02df72-6c6b-4577-b3bd-69c4833d11f5" released by "delete_volume" :: held 0.739s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Created reservations ['e898e7de-6caf-4cff-97bc-a90032f7703a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:50 devstack cinder-volume[87153]: WARNING cinder.quota [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2000426241 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2000426241, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:59:50 devstack cinder-volume[87153]: WARNING cinder.quota [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2000426241 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2000426241, it is now deprecated. Please use the default quota class for default quota. Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Created reservations ['b7359d7c-9ab6-4f91-87f4-529204bd7ea1', 'a90c51e9-5d81-45d0-8ef1-8c20073a6f63', 'a95435f0-08b3-4477-a02e-4357464ffad4', 'ae57cf2c-036b-4385-b551-afd0d7a00708'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:50 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" returned: 0 in 0.306s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "cinder-quobyte-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f" released by "delete_volume" :: held 0.734s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:50 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:50 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:50 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Created reservations ['005bb156-dbbd-4557-94cd-6c785a17386c', 'a6b9c1a4-9c2a-4c60-8be2-cd6292668aea', 'c7cca208-13ac-47aa-8c40-a0035f3add62', 'ed770642-067b-47bb-be54-c2e67fd54a6b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:51 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:51 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:51 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.347s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f7b69ef4-b289-4cec-b617-5283dc3ec546 tempest-GroupsV314Test-592002924 None] Delete group completed successfully. Jul 22 01:59:51 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.430s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Deleted volume successfully. Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Acquiring lock "cinder-quobyte-997ba258-6b1c-4242-89c1-0e2a56ddd8df" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4792610e-11d4-47d2-8df7-e1600662cedf tempest-VolumesCloneNegativeTest-1761476625 None] Lock "cinder-3ae12c97-399e-4c8b-9cc8-c380e9c8cf9f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-997ba258-6b1c-4242-89c1-0e2a56ddd8df" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4ffa8-9281-4c3b-b468-983454c2e0df]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:51 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:51 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:51 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:52 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df Jul 22 01:59:52 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:52 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-997ba258-6b1c-4242-89c1-0e2a56ddd8df" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Lock "cinder-quobyte-997ba258-6b1c-4242-89c1-0e2a56ddd8df" released by "delete_volume" :: held 0.842s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Created reservations ['e92ea221-53b6-4ea7-9c8a-e1dec724c89c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:52 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:52 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Created reservations ['8639f25e-c658-4134-aedb-4646bae64ab5', '79e7732e-fbbe-4346-a6c6-9cc755c60468', '52704f0a-0c37-428e-9d0c-46bcd76cc26f', '22a0c31f-4daa-4fe3-975c-dc799af19252'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:52 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 01:59:52 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:52 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.338s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 01:59:52 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 01:59:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-239f96f8-2efe-4541-a177-3eac43ed1562 tempest-GroupsV314Test-592002924 None] Delete group completed successfully. Jul 22 01:59:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-fc36b8a8-e113-4832-af17-4bf2e5b75890 req-4a2d0418-56e0-45d6-8f12-7b4bb5fa643d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-fc36b8a8-e113-4832-af17-4bf2e5b75890 req-4a2d0418-56e0-45d6-8f12-7b4bb5fa643d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-fc36b8a8-e113-4832-af17-4bf2e5b75890 req-4a2d0418-56e0-45d6-8f12-7b4bb5fa643d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-fc36b8a8-e113-4832-af17-4bf2e5b75890 req-4a2d0418-56e0-45d6-8f12-7b4bb5fa643d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-da8dc689-6bec-46b8-8758-30c09f02bbb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '294adcdc-2132-4ecd-aa5f-d1139664a35b', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 01:59:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-fc36b8a8-e113-4832-af17-4bf2e5b75890 req-4a2d0418-56e0-45d6-8f12-7b4bb5fa643d tempest-TestServerVolumeAttachmentScenario-1699287382 None] attachment_update completed successfully. Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (64db0ef1-02be-4c6e-bcb9-eb7789186839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d0d562-eb4f-424e-9230-13d6dbb080bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d0d562-eb4f-424e-9230-13d6dbb080bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-157183407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28e9d4a-acf1-4793-a2a9-05c0d418715c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:59Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9717a8cd-5044-4982-ba42-0d0265388dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9717a8cd-5044-4982-ba42-0d0265388dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2dba3b-c4d1-45c9-8f5d-d001c07c4d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2dba3b-c4d1-45c9-8f5d-d001c07c4d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28e9d4a-acf1-4793-a2a9-05c0d418715c', 'volume_name': 'volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76590d7f-7f50-4c0f-afd6-454db2a30eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76590d7f-7f50-4c0f-afd6-454db2a30eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b86d75-0d3d-4118-8c85-2fe536c2ca0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Volume f28e9d4a-acf1-4793-a2a9-05c0d418715c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c', 'volume_size': 1} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T23:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-157183407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28e9d4a-acf1-4793-a2a9-05c0d418715c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T23:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T23:59:59Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Creating volume f28e9d4a-acf1-4793-a2a9-05c0d418715c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 01:59:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 01:59:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:58 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c 1073741824 Jul 22 01:59:58 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e21c8ae4-22f4-4db3-b3dd-f37c43219447 tempest-GroupsV320Test-963848278 None] Group tempest-GroupsV320Test-Group-1964356966: creating Jul 22 01:59:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e21c8ae4-22f4-4db3-b3dd-f37c43219447 tempest-GroupsV320Test-963848278 None] Group tempest-GroupsV320Test-Group-1964356966: created successfully Jul 22 01:59:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e21c8ae4-22f4-4db3-b3dd-f37c43219447 tempest-GroupsV320Test-963848278 None] Create group completed successfully. Jul 22 01:59:59 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c 1073741824" returned: 0 in 0.585s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 01:59:59 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c Jul 22 01:59:59 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 01:59:59 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b86d75-0d3d-4118-8c85-2fe536c2ca0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83843d23-c6aa-42fe-bbd8-8ab301379524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 01:59:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Volume volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c (f28e9d4a-acf1-4793-a2a9-05c0d418715c): created successfully Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83843d23-c6aa-42fe-bbd8-8ab301379524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 01:59:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (64db0ef1-02be-4c6e-bcb9-eb7789186839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 01:59:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-110b1238-6a47-4d7d-9dc2-d19041975a4c tempest-AttachVolumeNegativeTest-739521749 None] Created volume successfully. Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Created reservations ['22031509-4ed2-494a-a774-223a376d0264'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:01 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:01 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:01 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.483s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0497e727-5151-4166-8764-aface783e7f1 tempest-GroupsV320Test-963848278 None] Delete group completed successfully. Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-156ea92e-cc39-4680-bd19-31f6abcf89bc req-b235d255-790b-41de-ac4d-eab4291ec27c tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-156ea92e-cc39-4680-bd19-31f6abcf89bc req-b235d255-790b-41de-ac4d-eab4291ec27c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-156ea92e-cc39-4680-bd19-31f6abcf89bc req-b235d255-790b-41de-ac4d-eab4291ec27c tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-156ea92e-cc39-4680-bd19-31f6abcf89bc req-b235d255-790b-41de-ac4d-eab4291ec27c tempest-AttachVolumeNegativeTest-739521749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e405b4e9-d864-434c-90d7-124ee2baaac1', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:00:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-156ea92e-cc39-4680-bd19-31f6abcf89bc req-b235d255-790b-41de-ac4d-eab4291ec27c tempest-AttachVolumeNegativeTest-739521749 None] attachment_update completed successfully. Jul 22 02:00:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-861871fe-8631-4141-b783-e4de8a13f121 req-8f409bf8-67c8-49a3-88d4-32ceb149704b tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-861871fe-8631-4141-b783-e4de8a13f121 req-8f409bf8-67c8-49a3-88d4-32ceb149704b tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-861871fe-8631-4141-b783-e4de8a13f121 req-8f409bf8-67c8-49a3-88d4-32ceb149704b tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-861871fe-8631-4141-b783-e4de8a13f121 req-8f409bf8-67c8-49a3-88d4-32ceb149704b tempest-TestServerVolumeAttachmentScenario-1699287382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-f3e6238a-84c2-4459-aa55-f2af52b068f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f9c3087-070b-4400-9d7f-01cd91067938', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:00:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-861871fe-8631-4141-b783-e4de8a13f121 req-8f409bf8-67c8-49a3-88d4-32ceb149704b tempest-TestServerVolumeAttachmentScenario-1699287382 None] attachment_update completed successfully. Jul 22 02:00:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-83dd1b9f-db2c-4ee7-8aa6-970056869ce2 req-a6b951b7-ce86-4511-8469-481ddd6f76cd tempest-AttachVolumeNegativeTest-739521749 None] Terminate volume connection completed successfully. Jul 22 02:00:05 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-83dd1b9f-db2c-4ee7-8aa6-970056869ce2 req-a6b951b7-ce86-4511-8469-481ddd6f76cd tempest-AttachVolumeNegativeTest-739521749 None] Deleting attachment e405b4e9-d864-434c-90d7-124ee2baaac1. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:00:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-a8bde42c-8da1-4e67-932e-0a5d9935423d req-8b60f874-946a-4657-956f-140f5c1e3c8c tempest-TestServerVolumeAttachmentScenario-1699287382 None] Terminate volume connection completed successfully. Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-a8bde42c-8da1-4e67-932e-0a5d9935423d req-8b60f874-946a-4657-956f-140f5c1e3c8c tempest-TestServerVolumeAttachmentScenario-1699287382 None] Deleting attachment 3f9c3087-070b-4400-9d7f-01cd91067938. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (de613e53-4df2-451c-b59b-1266319f867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d395eef1-af74-4c54-9a31-11de6339c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d395eef1-af74-4c54-9a31-11de6339c037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-918580588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304f83a-fac9-4f98-ac8d-825d7054ff8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:07Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b6afb-f135-4415-a4a5-e588d631ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b6afb-f135-4415-a4a5-e588d631ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930ac49-3a15-4eb6-b7d4-736d27adf1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930ac49-3a15-4eb6-b7d4-736d27adf1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3304f83a-fac9-4f98-ac8d-825d7054ff8e', 'volume_name': 'volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc073c09-5d1a-4eec-8bff-1849eb3b1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc073c09-5d1a-4eec-8bff-1849eb3b1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4f8fb0-ebd4-4419-be39-b72e8d923349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Volume 3304f83a-fac9-4f98-ac8d-825d7054ff8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e', 'volume_size': 1} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-918580588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304f83a-fac9-4f98-ac8d-825d7054ff8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:07Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Creating volume 3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:06 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e 1073741824 Jul 22 02:00:07 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:07 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e 1073741824" returned: 0 in 0.749s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:07 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e Jul 22 02:00:07 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-0483e097-a6f2-42ed-8816-b1a586207344 req-76e22466-fde2-46e2-836f-f7d05983050d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Terminate volume connection completed successfully. Jul 22 02:00:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-0483e097-a6f2-42ed-8816-b1a586207344 req-76e22466-fde2-46e2-836f-f7d05983050d tempest-TestServerVolumeAttachmentScenario-1699287382 None] Deleting attachment 294adcdc-2132-4ecd-aa5f-d1139664a35b. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:00:08 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e" returned: 0 in 0.522s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4f8fb0-ebd4-4419-be39-b72e8d923349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a656b9-0a19-44ca-95e0-2915b225ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:08 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Volume volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e (3304f83a-fac9-4f98-ac8d-825d7054ff8e): created successfully Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a656b9-0a19-44ca-95e0-2915b225ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (de613e53-4df2-451c-b59b-1266319f867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-24dadde2-c4af-491f-a7fa-12069926827a tempest-VolumesSnapshotTestJSON-24533531 None] Created volume successfully. Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Creating offline snapshot a254de40-8599-41de-b440-197d90677374 of volume 3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aa84ed-5856-47b4-98f1-507aa518182d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:09 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e Jul 22 02:00:09 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:09 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e" returned: 0 in 0.595s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:10 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 1G Jul 22 02:00:10 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:10 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 1G" returned: 0 in 0.714s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:10 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 Jul 22 02:00:10 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:11 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374" returned: 0 in 0.509s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:11 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 is being set with open permissions: ugo+rw Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:11 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 Jul 22 02:00:11 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:11 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374" returned: 0 in 0.358s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:11 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info Jul 22 02:00:11 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:11 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info" returned: 0 in 0.308s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:11 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info is being set with open permissions: ugo+rw Jul 22 02:00:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:11 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info Jul 22 02:00:11 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Flow 'volume_create_manager' (8a1b6a6e-1d26-4c78-9528-555fdd8a037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41deb7f6-ee41-4c94-926e-2aaef3a05dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41deb7f6-ee41-4c94-926e-2aaef3a05dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-558092543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0362790-ac3f-400f-b757-a3481e5cacb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a726f2a0de4cfaa149a1e1987e72f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:12Z,use_quota=True,user_id='f3142550ede142f5ad93a186d5e564c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fef8c8-b15d-4d3a-a7b5-c0ee05e5a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6fef8c8-b15d-4d3a-a7b5-c0ee05e5a57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae5d560-2bd4-4abd-9f0b-5ec932a95bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae5d560-2bd4-4abd-9f0b-5ec932a95bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0362790-ac3f-400f-b757-a3481e5cacb8', 'volume_name': 'volume-b0362790-ac3f-400f-b757-a3481e5cacb8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0cc763-8ca3-4cd2-91c9-06a015f29498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0cc763-8ca3-4cd2-91c9-06a015f29498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acca771-023a-4655-a61b-42a631df22ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:12 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Volume b0362790-ac3f-400f-b757-a3481e5cacb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0362790-ac3f-400f-b757-a3481e5cacb8', 'volume_size': 1} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:12 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.info" returned: 0 in 0.380s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.079s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-558092543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0362790-ac3f-400f-b757-a3481e5cacb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a726f2a0de4cfaa149a1e1987e72f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:12Z,use_quota=True,user_id='f3142550ede142f5ad93a186d5e564c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Creating volume b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:12 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:12 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 1073741824 Jul 22 02:00:12 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a9dd6977-3eb0-4c5c-ac7f-a51d053dd7a4 tempest-VolumesSnapshotTestJSON-24533531 None] Create snapshot completed successfully Jul 22 02:00:12 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 1073741824" returned: 0 in 0.540s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:12 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 Jul 22 02:00:12 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "cinder-f3e6238a-84c2-4459-aa55-f2af52b068f8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-f3e6238a-84c2-4459-aa55-f2af52b068f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "cinder-quobyte-f3e6238a-84c2-4459-aa55-f2af52b068f8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-quobyte-f3e6238a-84c2-4459-aa55-f2af52b068f8" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:13 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8" returned: 0 in 0.346s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[646988a8-1444-4160-92f5-2d68473cbd6d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acca771-023a-4655-a61b-42a631df22ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0362790-ac3f-400f-b757-a3481e5cacb8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df2db49-8f7c-4049-ae90-2d882e595db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Volume volume-b0362790-ac3f-400f-b757-a3481e5cacb8 (b0362790-ac3f-400f-b757-a3481e5cacb8): created successfully Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df2db49-8f7c-4049-ae90-2d882e595db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Flow 'volume_create_manager' (8a1b6a6e-1d26-4c78-9528-555fdd8a037e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-97b7a780-42ec-4ac2-9c1a-ef7af3dee075 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Created volume successfully. Jul 22 02:00:13 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 Jul 22 02:00:13 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-a254de40-8599-41de-b440-197d90677374-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-a254de40-8599-41de-b440-197d90677374-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:13 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-a254de40-8599-41de-b440-197d90677374" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8" returned: 0 in 0.506s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-a254de40-8599-41de-b440-197d90677374" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Deleting offline snapshot a254de40-8599-41de-b440-197d90677374 of volume 3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:00:13 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8 Jul 22 02:00:13 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] snapshot_file for this snap is: volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d44346-e8a7-45d0-90c8-b4320ee62778]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:13 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 Jul 22 02:00:13 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:14 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f3e6238a-84c2-4459-aa55-f2af52b068f8" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-quobyte-f3e6238a-84c2-4459-aa55-f2af52b068f8" released by "delete_volume" :: held 0.839s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Created reservations ['e4f1c41c-5336-4cd4-8623-f1f241392ded', 'f8ee57fb-1a3a-4575-97e2-69318eef0ce8', 'b728678b-66a4-4922-8761-a2e6ee9742f9', 'a94bf2ad-decb-45a9-9830-933661fafe3c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:14 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:14 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:14 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374" returned: 0 in 0.443s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "cinder-da8dc689-6bec-46b8-8758-30c09f02bbb3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[575234a1-aae9-4edb-a117-bbb52fb55e14]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-da8dc689-6bec-46b8-8758-30c09f02bbb3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "cinder-quobyte-da8dc689-6bec-46b8-8758-30c09f02bbb3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-quobyte-da8dc689-6bec-46b8-8758-30c09f02bbb3" acquired by "delete_volume" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:14 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e Jul 22 02:00:14 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Creating offline snapshot 182f5314-6aa8-4b9f-95b8-eb92dc4c545d of volume b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed506273-f5d5-4a9a-93f7-a25f75129349]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaffae49-1b50-4c7a-8c9c-14da3b532537]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:14 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:14 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Deleted volume successfully. Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-af5fecf4-8339-4a98-81a6-229ddc9e45b0 tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-f3e6238a-84c2-4459-aa55-f2af52b068f8-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:14 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 Jul 22 02:00:14 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:14 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 Jul 22 02:00:14 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:14 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e" returned: 0 in 0.512s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:14 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 Jul 22 02:00:14 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3" returned: 0 in 0.533s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:15 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8" returned: 0 in 0.530s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:15 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3 Jul 22 02:00:15 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d 1G Jul 22 02:00:15 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:15 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374 Jul 22 02:00:15 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da8dc689-6bec-46b8-8758-30c09f02bbb3" returned: 0 in 0.330s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-quobyte-da8dc689-6bec-46b8-8758-30c09f02bbb3" released by "delete_volume" :: held 0.918s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Created reservations ['a165886b-41ea-46e6-b752-a72503b4688f', '0297be93-a7af-49b2-91bb-aade9edfdfdd', '1a23d7b0-f05b-4061-a81d-2060d18940fe', '3b27d8f6-1f7e-48ec-9d87-388c4a19d5c7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:15 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e.a254de40-8599-41de-b440-197d90677374" returned: 0 in 0.346s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:15 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d 1G" returned: 0 in 0.580s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0362790-ac3f-400f-b757-a3481e5cacb8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-a254de40-8599-41de-b440-197d90677374" released by "_delete_snapshot" :: held 1.940s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" released by "delete_snapshot" :: held 1.986s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:15 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0362790-ac3f-400f-b757-a3481e5cacb8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d Jul 22 02:00:15 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['6a2cc9bd-048f-4177-9513-35e05fb24bca', 'fd119d1d-b1f9-4f4a-89e5-99150d57fff2', 'be9305c1-c403-4b58-92bf-d8110d1efbd1', '06e81873-f948-43e8-8abe-b8cf0d34a596'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:15 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Delete snapshot completed successfully. Jul 22 02:00:15 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4b24759c-4c4d-4aa2-ad5f-4e4f1acb861f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-a254de40-8599-41de-b440-197d90677374-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:16 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.373s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Deleted volume successfully. Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-db6439dc-9361-4835-900b-52d52ff7d49a tempest-TestServerVolumeAttachmentScenario-1699287382 None] Lock "cinder-da8dc689-6bec-46b8-8758-30c09f02bbb3-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:16 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0362790-ac3f-400f-b757-a3481e5cacb8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:16 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d is being set with open permissions: ugo+rw Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:16 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d Jul 22 02:00:16 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:16 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:16 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info Jul 22 02:00:16 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:16 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info" returned: 0 in 0.304s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:16 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info is being set with open permissions: ugo+rw Jul 22 02:00:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:16 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info Jul 22 02:00:16 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:17 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.info" returned: 0 in 0.405s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9e8bd5c7-2131-4d01-862f-eaf12613cea5 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Create snapshot completed successfully Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (010bf2df-e08b-4a65-a512-1a93d6e17f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636f2449-2778-4e67-81ac-c8b783f48851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636f2449-2778-4e67-81ac-c8b783f48851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-79346515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff0ec8b-b34d-4a0d-ab06-2f389a819d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:18Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb0c17d-bd13-46a1-8d3e-70930e1407b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb0c17d-bd13-46a1-8d3e-70930e1407b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc86f608-f4f3-4ed0-a1ab-0720d6dff581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc86f608-f4f3-4ed0-a1ab-0720d6dff581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff0ec8b-b34d-4a0d-ab06-2f389a819d25', 'volume_name': 'volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4e8af3-20e1-4deb-ace6-02bdc7913fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4e8af3-20e1-4deb-ace6-02bdc7913fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0a3217-42c1-4920-8182-16e511aeae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Volume fff0ec8b-b34d-4a0d-ab06-2f389a819d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25', 'volume_size': 1} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-79346515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff0ec8b-b34d-4a0d-ab06-2f389a819d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:18Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Creating volume fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:17 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:17 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 1073741824 Jul 22 02:00:17 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "cinder-182f5314-6aa8-4b9f-95b8-eb92dc4c545d-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-182f5314-6aa8-4b9f-95b8-eb92dc4c545d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "cinder-quobyte-182f5314-6aa8-4b9f-95b8-eb92dc4c545d" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-182f5314-6aa8-4b9f-95b8-eb92dc4c545d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Deleting offline snapshot 182f5314-6aa8-4b9f-95b8-eb92dc4c545d of volume b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] snapshot_file for this snap is: volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67af79-7614-43bc-af93-12f71a463955]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:18 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 1073741824" returned: 0 in 0.650s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:18 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:18 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:18 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d Jul 22 02:00:18 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:18 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.343s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0a3217-42c1-4920-8182-16e511aeae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f74d93-9438-4d83-bd02-cc14ce680cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Volume volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 (fff0ec8b-b34d-4a0d-ab06-2f389a819d25): created successfully Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f74d93-9438-4d83-bd02-cc14ce680cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (010bf2df-e08b-4a65-a512-1a93d6e17f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-543e2080-0f9c-483d-a57a-b7ac2aff4d7e tempest-VolumesSnapshotTestJSON-24533531 None] Created volume successfully. Jul 22 02:00:19 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d" returned: 0 in 0.563s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0362790-ac3f-400f-b757-a3481e5cacb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[014eeba3-8397-4c81-8a5f-4a3ff021978c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:19 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 Jul 22 02:00:19 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:19 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8" returned: 0 in 0.473s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:19 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d Jul 22 02:00:19 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:20 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d" returned: 0 in 0.790s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Creating offline snapshot efb926e7-f1e6-4525-86d0-113b4461c028 of volume fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:00:20 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d Jul 22 02:00:20 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfbe9eb-f704-4ef6-8ccd-5588416e6172]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:20 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:20 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:20 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8.182f5314-6aa8-4b9f-95b8-eb92dc4c545d" returned: 0 in 0.613s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-182f5314-6aa8-4b9f-95b8-eb92dc4c545d" released by "_delete_snapshot" :: held 2.597s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" released by "delete_snapshot" :: held 2.631s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Created reservations ['c5fe10a9-371a-4b48-81d6-b083a2de48a1', '41bc9b6e-37b0-42bb-b1f3-31f00c9a300d', '02a60b5a-b732-4bad-8827-f98a43c3402f', 'b6bd7b6f-d2cc-4907-b82d-83a58abe176c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:21 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Delete snapshot completed successfully. Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.807s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-da7e86fc-f673-4e5c-ad37-7098bfc7dc28 tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-182f5314-6aa8-4b9f-95b8-eb92dc4c545d-delete_snapshot" released by "delete_snapshot" :: held 2.886s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:21 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 1G Jul 22 02:00:21 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "cinder-b0362790-ac3f-400f-b757-a3481e5cacb8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-b0362790-ac3f-400f-b757-a3481e5cacb8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" acquired by "delete_volume" :: waited 0.046s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[440029be-c952-4107-8df0-f0fecc5e81a0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:22 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 1G" returned: 0 in 0.922s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:22 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:22 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:22 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 Jul 22 02:00:22 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:22 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:22 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8" returned: 0 in 0.610s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.594s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:22 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 is being set with open permissions: ugo+rw Jul 22 02:00:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:22 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8 Jul 22 02:00:22 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:22 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:22 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:23 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b0362790-ac3f-400f-b757-a3481e5cacb8" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-quobyte-b0362790-ac3f-400f-b757-a3481e5cacb8" released by "delete_volume" :: held 1.106s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Created reservations ['1ca13ee0-e374-45aa-bad7-f39826f28295', '1ec9e3d1-d59d-4dc8-9466-72862e289916', '3acccd06-d22a-43c3-9dc5-3bfc8f29f624', '1c45c738-4eba-4f51-a60e-e7fddd481f51'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:23 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.496s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:23 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info Jul 22 02:00:23 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:23 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:23 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:23 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info" returned: 0 in 0.493s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:23 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info is being set with open permissions: ugo+rw Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:23 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info Jul 22 02:00:23 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:23 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.553s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:23 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Deleted volume successfully. Jul 22 02:00:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dfb358ff-5924-4475-a693-cba7accb083d tempest-VolumeSnapshotQuotasNegativeTestJSON-593082789 None] Lock "cinder-b0362790-ac3f-400f-b757-a3481e5cacb8-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:24 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.info" returned: 0 in 0.513s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.978s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-95246f31-41cd-4f8b-9c77-e5bcc7617e3f tempest-VolumesSnapshotTestJSON-24533531 None] Create snapshot completed successfully Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (306f83b0-6236-4e9a-b038-ecc2f6a50b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e8944c-36bb-4101-a353-c6aec99aa052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e8944c-36bb-4101-a353-c6aec99aa052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-932986567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b70d791-ca9d-4643-ad4b-dda73d72e523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=efb926e7-f1e6-4525-86d0-113b4461c028,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:26Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381cbdab-6f5f-48ab-92f4-3aff6306f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381cbdab-6f5f-48ab-92f4-3aff6306f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d6c3fd-8dee-4668-a8a6-2b68149d8c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d6c3fd-8dee-4668-a8a6-2b68149d8c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1b70d791-ca9d-4643-ad4b-dda73d72e523', 'volume_name': 'volume-1b70d791-ca9d-4643-ad4b-dda73d72e523', 'volume_size': 2, 'snapshot_id': 'efb926e7-f1e6-4525-86d0-113b4461c028'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7def6eed-3f21-427e-9cae-dcaa4d8024c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7def6eed-3f21-427e-9cae-dcaa4d8024c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e65dd-b9a7-4437-8dac-7b865518f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Volume 1b70d791-ca9d-4643-ad4b-dda73d72e523: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1b70d791-ca9d-4643-ad4b-dda73d72e523', 'volume_size': 2, 'snapshot_id': 'efb926e7-f1e6-4525-86d0-113b4461c028'} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028-1b70d791-ca9d-4643-ad4b-dda73d72e523" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028-1b70d791-ca9d-4643-ad4b-dda73d72e523" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Creating volume 1b70d791-ca9d-4643-ad4b-dda73d72e523 from snapshot efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] snapshot: efb926e7-f1e6-4525-86d0-113b4461c028, volume: 1b70d791-ca9d-4643-ad4b-dda73d72e523, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb49451-a11c-4630-8e3f-2f33268918d6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:26 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:26 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:27 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.690s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[57545e3a-0050-4e47-9922-6b84ff869f96]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:27 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:27 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:27 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.502s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:00:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:27 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 Jul 22 02:00:27 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:35 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523" returned: 0 in 7.495s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0f55e-f42b-42fc-a6b5-2270223d3cd6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:35 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:35 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:35 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.639s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:00:35 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Converted 1024.00 MB image at 136.60 MB/s Jul 22 02:00:35 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 is being set with open permissions: ugo+rw Jul 22 02:00:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:36 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 Jul 22 02:00:36 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:36 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" released by "_copy_volume_from_snapshot" :: held 9.754s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028-1b70d791-ca9d-4643-ad4b-dda73d72e523" released by "_create_volume_from_snapshot" :: held 9.801s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.819s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06e65dd-b9a7-4437-8dac-7b865518f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b70d791-ca9d-4643-ad4b-dda73d72e523', 'volume_size': 2, 'snapshot_id': 'efb926e7-f1e6-4525-86d0-113b4461c028'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967cdb55-6f62-4b99-9ce7-4a6905f8e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Volume volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 (1b70d791-ca9d-4643-ad4b-dda73d72e523): created successfully Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967cdb55-6f62-4b99-9ce7-4a6905f8e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (306f83b0-6236-4e9a-b038-ecc2f6a50b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b7951452-cb18-4af4-a308-46e76ab1d943 tempest-VolumesSnapshotTestJSON-24533531 None] Created volume successfully. Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-1b70d791-ca9d-4643-ad4b-dda73d72e523-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-1b70d791-ca9d-4643-ad4b-dda73d72e523-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e01a53-d3e0-41d0-834b-adfb21f9095e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Flow 'volume_create_manager' (9b18be63-1ce8-4eb2-8f39-30a4f954110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69b6732-acda-424d-8e1d-3dbed2bdf17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69b6732-acda-424d-8e1d-3dbed2bdf17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1306545061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e0fa08-01e7-40e2-b86e-c4e49edc54b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3524a2b4f44fe8c25ba2b09e03ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:37Z,use_quota=True,user_id='31b8046fb7e848c9ab258070cc212844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8de91d0f-852d-499c-8d9b-c37712a91772),volume_type_id=8de91d0f-852d-499c-8d9b-c37712a91772)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c7e599-a14d-4726-82f9-c519750a115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c7e599-a14d-4726-82f9-c519750a115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc92877-9ebd-4dae-ae43-70e0356fc750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc92877-9ebd-4dae-ae43-70e0356fc750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e0fa08-01e7-40e2-b86e-c4e49edc54b5', 'volume_name': 'volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a64017-a38b-4380-9a86-edb97d786391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a64017-a38b-4380-9a86-edb97d786391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890d8578-b206-43a2-a4be-26af6dcacb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Volume 40e0fa08-01e7-40e2-b86e-c4e49edc54b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5', 'volume_size': 1} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1306545061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e0fa08-01e7-40e2-b86e-c4e49edc54b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3524a2b4f44fe8c25ba2b09e03ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:37Z,use_quota=True,user_id='31b8046fb7e848c9ab258070cc212844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8de91d0f-852d-499c-8d9b-c37712a91772),volume_type_id=8de91d0f-852d-499c-8d9b-c37712a91772)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Creating volume 40e0fa08-01e7-40e2-b86e-c4e49edc54b5 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:37 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:37 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 Jul 22 02:00:37 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:37 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 1073741824 Jul 22 02:00:37 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:37 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523" returned: 0 in 0.423s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:37 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523 Jul 22 02:00:37 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:37 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 1073741824" returned: 0 in 0.511s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:37 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 Jul 22 02:00:37 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:37 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b70d791-ca9d-4643-ad4b-dda73d72e523" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-1b70d791-ca9d-4643-ad4b-dda73d72e523" released by "delete_volume" :: held 0.772s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['f93421c1-6eac-4303-a718-e216e456a351', '0526c7a5-960a-4e48-bb94-6103400f0ae1', '88068a25-3824-4e9e-bf3a-37efa1ef50ae', 'd902deb9-0e6f-4e03-96ca-22919f4c8b2a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:37 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:37 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:38 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890d8578-b206-43a2-a4be-26af6dcacb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5942275-4241-4bd1-a91b-9a23009d9275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:38 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Volume volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 (40e0fa08-01e7-40e2-b86e-c4e49edc54b5): created successfully Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5942275-4241-4bd1-a91b-9a23009d9275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Flow 'volume_create_manager' (9b18be63-1ce8-4eb2-8f39-30a4f954110c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-aebd57d1-ae97-4bf0-8e88-b46056f81aa5 tempest-VolumeTypesAccessTest-486864957 None] Created volume successfully. Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-efb926e7-f1e6-4525-86d0-113b4461c028-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-efb926e7-f1e6-4525-86d0-113b4461c028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:38 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Deleting offline snapshot efb926e7-f1e6-4525-86d0-113b4461c028 of volume fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] snapshot_file for this snap is: volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Deleted volume successfully. Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce889b46-e69d-4507-b2c4-4e67bffb00ca]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ce884acf-1b82-43e6-8d9b-e1a16806d7a5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-1b70d791-ca9d-4643-ad4b-dda73d72e523-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:38 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:38 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:38 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.397s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25ff06-c174-4ca7-ba95-46db7aee582a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:38 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:38 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:39 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.385s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:39 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:39 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Acquiring lock "cinder-40e0fa08-01e7-40e2-b86e-c4e49edc54b5-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "cinder-40e0fa08-01e7-40e2-b86e-c4e49edc54b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Acquiring lock "cinder-quobyte-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "cinder-quobyte-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9388dcf-eb50-41d4-88f1-d55eec320c5e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:39 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 Jul 22 02:00:39 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:39 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.416s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:39 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028 Jul 22 02:00:39 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:39 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" returned: 0 in 0.418s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:39 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5 Jul 22 02:00:39 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:39 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25.efb926e7-f1e6-4525-86d0-113b4461c028" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-efb926e7-f1e6-4525-86d0-113b4461c028" released by "_delete_snapshot" :: held 1.612s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" released by "delete_snapshot" :: held 1.641s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['d38eac06-7d90-48f1-9f5b-ae1557db9b93', 'd233eeaa-1bc4-4b63-ad1a-aeb29530eba2', '7bd6c92c-6eea-4291-9f6c-d3bf7bc83507', '062985f4-97c9-426c-81f9-2c8eacad7534'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Delete snapshot completed successfully. Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9a34c96e-58d5-468d-89c7-0022199b0539 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-efb926e7-f1e6-4525-86d0-113b4461c028-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:40 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "cinder-quobyte-40e0fa08-01e7-40e2-b86e-c4e49edc54b5" released by "delete_volume" :: held 0.767s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:40 devstack cinder-volume[87153]: WARNING cinder.quota [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-176044748 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-176044748, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:00:40 devstack cinder-volume[87153]: WARNING cinder.quota [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-176044748 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-176044748, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Created reservations ['450c073c-9577-4ab4-a7f4-0c952e767cda', 'e9b440cc-43c0-4aaf-99f3-93fdecd73914', '81ee180b-29b6-4b6e-aca4-c975c80dc86e', 'e584f68a-c55f-4aa6-af22-0fb6df047867'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:40 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:40 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:40 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Deleted volume successfully. Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a93cc3ef-2f5d-4168-bde8-28807c0b0e1c tempest-VolumeTypesAccessTest-486864957 None] Lock "cinder-40e0fa08-01e7-40e2-b86e-c4e49edc54b5-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-fff0ec8b-b34d-4a0d-ab06-2f389a819d25-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-fff0ec8b-b34d-4a0d-ab06-2f389a819d25-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e613a91-b5f0-4f2b-941b-9e5e960b951f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:40 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:40 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:41 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.546s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:41 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25 Jul 22 02:00:41 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:41 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" returned: 0 in 0.285s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-fff0ec8b-b34d-4a0d-ab06-2f389a819d25" released by "delete_volume" :: held 0.924s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['4d722327-709a-41a5-9159-c2bbefcb3d29', 'f1919f2b-176d-4548-a1ee-85746eee28e8', 'fd0fb8c1-ef3c-4ec4-93cf-ad6774824761', 'a4d51cb5-a7ba-4ce8-81d9-9e26dd474522'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:41 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:41 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:42 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:42 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Deleted volume successfully. Jul 22 02:00:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cca8e48f-1f73-4820-a65e-b9c9226f0008 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-fff0ec8b-b34d-4a0d-ab06-2f389a819d25-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (55e32f0d-849f-4c34-a4e1-186553bc55d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd7476a-aefd-4b0b-9977-b59411240c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd7476a-aefd-4b0b-9977-b59411240c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-455597853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dff1fa9-8dad-4aa0-9714-cde75a60518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:43Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b20a914-09a1-4f4b-90d9-edd17ceb3be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b20a914-09a1-4f4b-90d9-edd17ceb3be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996284f1-81ec-4aba-a6bb-12568a16dcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996284f1-81ec-4aba-a6bb-12568a16dcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dff1fa9-8dad-4aa0-9714-cde75a60518e', 'volume_name': 'volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba54847-9ae1-40e9-98ae-1f5111b955e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba54847-9ae1-40e9-98ae-1f5111b955e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c34c84-c106-4bdc-adaa-631a96571ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:43 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Volume 0dff1fa9-8dad-4aa0-9714-cde75a60518e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e', 'volume_size': 1} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-455597853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dff1fa9-8dad-4aa0-9714-cde75a60518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:43Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Creating volume 0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:43 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:43 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e 1073741824 Jul 22 02:00:43 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:44 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e 1073741824" returned: 0 in 0.557s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:44 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:00:44 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:44 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.320s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c34c84-c106-4bdc-adaa-631a96571ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f2a51b-8bdd-4857-9bd1-a624c7f49aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:44 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Volume volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e (0dff1fa9-8dad-4aa0-9714-cde75a60518e): created successfully Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f2a51b-8bdd-4857-9bd1-a624c7f49aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (55e32f0d-849f-4c34-a4e1-186553bc55d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:44 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6bd39b76-2aed-4edb-b2cd-cbdccfa25ef5 tempest-VolumesSnapshotTestJSON-24533531 None] Created volume successfully. Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=136,cinder:SELECT=138,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=131,cinder:SELECT=126,cinder:DELETE=6,cinder:INSERT=25 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Creating offline snapshot 8be2c519-0242-48f0-b1da-80e763c985ac of volume 0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[824767ad-28ab-43a2-bf3c-d8d4c41eb923]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:46 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:00:46 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (10288724-f232-4559-9357-e1fc93efd8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b15b218-faa8-4679-8f5a-8b23627d52ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b15b218-faa8-4679-8f5a-8b23627d52ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1740314210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be520053-3c0b-4615-9987-c6cd75e62b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:46Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58934a69-3e57-4b47-9634-f5644f3fff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58934a69-3e57-4b47-9634-f5644f3fff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9f944a-a73b-46f2-87ec-eeeed6f73254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9f944a-a73b-46f2-87ec-eeeed6f73254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be520053-3c0b-4615-9987-c6cd75e62b19', 'volume_name': 'volume-be520053-3c0b-4615-9987-c6cd75e62b19', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c2712d-55db-43d0-bac0-c997d66dd178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c2712d-55db-43d0-bac0-c997d66dd178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55423894-9625-412d-8683-1d4b7fd24f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Volume be520053-3c0b-4615-9987-c6cd75e62b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be520053-3c0b-4615-9987-c6cd75e62b19', 'volume_size': 1} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:46 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.575s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:46 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac 1G Jul 22 02:00:46 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:46 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac 1G" returned: 0 in 0.489s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:46 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:00:46 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:47 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:47 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac is being set with open permissions: ugo+rw Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:47 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:00:47 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:47 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.299s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:47 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info Jul 22 02:00:47 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:47 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info" returned: 0 in 0.306s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:47 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info is being set with open permissions: ugo+rw Jul 22 02:00:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:47 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info Jul 22 02:00:47 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:48 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.info" returned: 0 in 0.285s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1740314210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be520053-3c0b-4615-9987-c6cd75e62b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9fe515cb8e4059be2a8cee3deec8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:46Z,use_quota=True,user_id='6d84b54ecfdd4c7c8b22dcc7820e90dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Creating volume be520053-3c0b-4615-9987-c6cd75e62b19 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:48 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 1073741824 Jul 22 02:00:48 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7382ff9c-47fc-4e27-8d7a-2eb5bd3aef9d tempest-VolumesSnapshotTestJSON-24533531 None] Create snapshot completed successfully Jul 22 02:00:48 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 1073741824" returned: 0 in 0.543s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:48 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 Jul 22 02:00:48 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (e2958ec0-5361-4c29-b0cb-24041f61c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649071b-746c-4d72-83ac-634d146299b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649071b-746c-4d72-83ac-634d146299b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-476762774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c61127-a730-435c-a81a-40acca59022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:49Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda9dc1-fe52-40f9-9ba3-8a510778d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eda9dc1-fe52-40f9-9ba3-8a510778d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae6b29-53fc-4e5b-9a58-f91ecee2ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bae6b29-53fc-4e5b-9a58-f91ecee2ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c61127-a730-435c-a81a-40acca59022c', 'volume_name': 'volume-c0c61127-a730-435c-a81a-40acca59022c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1006c0-e2ba-4183-8d6c-a1f415a6b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1006c0-e2ba-4183-8d6c-a1f415a6b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660ff05-4d70-4840-bd8b-2369d7eb43d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Volume c0c61127-a730-435c-a81a-40acca59022c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c61127-a730-435c-a81a-40acca59022c', 'volume_size': 1} Jul 22 02:00:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:49 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-476762774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c61127-a730-435c-a81a-40acca59022c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:49Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Creating volume c0c61127-a730-435c-a81a-40acca59022c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:49 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55423894-9625-412d-8683-1d4b7fd24f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be520053-3c0b-4615-9987-c6cd75e62b19', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb3b5af-8c84-47fa-996f-cfbd52061826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c 1073741824 Jul 22 02:00:49 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:49 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Volume volume-be520053-3c0b-4615-9987-c6cd75e62b19 (be520053-3c0b-4615-9987-c6cd75e62b19): created successfully Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb3b5af-8c84-47fa-996f-cfbd52061826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Flow 'volume_create_manager' (10288724-f232-4559-9357-e1fc93efd8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f4a1ad47-a050-4aa9-8a5e-a93a673c7c06 tempest-AttachVolumeNegativeTest-739521749 None] Created volume successfully. Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (2cfedc02-6c9a-4bd6-aa04-a32c35f44fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4df6346-48cf-4881-9bcd-286d1858cb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4df6346-48cf-4881-9bcd-286d1858cb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1186674601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b9463f-620b-4278-b6fa-26ea4a29c3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458e3390e7ff42a487ce6e863005ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8be2c519-0242-48f0-b1da-80e763c985ac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:50Z,use_quota=True,user_id='efa8f3299f824fe79f7571e7aacc64f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6743de7-f86d-4e87-bbc3-f036c75ea086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6743de7-f86d-4e87-bbc3-f036c75ea086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dde8299-8b9b-473a-9165-5d1d8c99c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dde8299-8b9b-473a-9165-5d1d8c99c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84b9463f-620b-4278-b6fa-26ea4a29c3dc', 'volume_name': 'volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc', 'volume_size': 1, 'snapshot_id': '8be2c519-0242-48f0-b1da-80e763c985ac'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ecf28b-dac4-4ba5-8613-0ede212c92c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ecf28b-dac4-4ba5-8613-0ede212c92c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727aabea-d7ec-41aa-8a77-01cc8898c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:49 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Volume 84b9463f-620b-4278-b6fa-26ea4a29c3dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc', 'volume_size': 1, 'snapshot_id': '8be2c519-0242-48f0-b1da-80e763c985ac'} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:50 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c 1073741824" returned: 0 in 0.835s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:50 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c Jul 22 02:00:50 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:50 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c" returned: 0 in 0.287s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.411s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac-84b9463f-620b-4278-b6fa-26ea4a29c3dc" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660ff05-4d70-4840-bd8b-2369d7eb43d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c61127-a730-435c-a81a-40acca59022c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b0c9f-85f5-432c-a3e9-9458f3390f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac-84b9463f-620b-4278-b6fa-26ea4a29c3dc" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Creating volume 84b9463f-620b-4278-b6fa-26ea4a29c3dc from snapshot 8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Volume volume-c0c61127-a730-435c-a81a-40acca59022c (c0c61127-a730-435c-a81a-40acca59022c): created successfully Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef5b0c9f-85f5-432c-a3e9-9458f3390f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (e2958ec0-5361-4c29-b0cb-24041f61c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] snapshot: 8be2c519-0242-48f0-b1da-80e763c985ac, volume: 84b9463f-620b-4278-b6fa-26ea4a29c3dc, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3d6dc7a0-6d73-4989-a8c8-91023fc951ca req-fbb2c35d-3a1d-4552-a3a2-11fa62f77360 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:50 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b67c8a6c-8c49-43ce-b5c7-d583b1ee72f9 tempest-VolumesListAdminTestJSON-1892830039 None] Created volume successfully. Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[66652673-9e89-4f03-91b3-ef7197045960]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:50 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:00:50 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:50 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.397s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f61d5-e471-4658-9f6b-36f8c7b791d7]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:51 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:00:51 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:51 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.426s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:51 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc Jul 22 02:00:51 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (d6c3814e-8aa3-44e4-bbf1-1b7d4d003f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab0fef6-eb1f-46f0-8b6b-51ce1015553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab0fef6-eb1f-46f0-8b6b-51ce1015553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-547086209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5bab6b-7c39-4f45-bf52-3ed91d030e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:52Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f77609-4d37-4e2f-8991-773f8ae02f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f77609-4d37-4e2f-8991-773f8ae02f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da660a52-5f8c-440e-a44f-997bb722958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da660a52-5f8c-440e-a44f-997bb722958d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5bab6b-7c39-4f45-bf52-3ed91d030e23', 'volume_name': 'volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7740f6e-85c0-41c9-88d8-63baa707c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7740f6e-85c0-41c9-88d8-63baa707c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562e0e38-9999-4005-b506-b76b85444fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Volume dd5bab6b-7c39-4f45-bf52-3ed91d030e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23', 'volume_size': 1} Jul 22 02:00:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:52 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:52 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:52 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.509s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:00:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 8 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:00:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:00:56 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc" returned: 0 in 5.057s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f639ab4-9334-42c6-8f71-84fa0d9c396a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:56 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:00:56 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:57 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.553s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:00:57 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Converted 1024.00 MB image at 202.46 MB/s Jul 22 02:00:57 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc is being set with open permissions: ugo+rw Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:57 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc Jul 22 02:00:57 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:57 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" released by "_copy_volume_from_snapshot" :: held 6.798s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac-84b9463f-620b-4278-b6fa-26ea4a29c3dc" released by "_create_volume_from_snapshot" :: held 6.859s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.891s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3d6dc7a0-6d73-4989-a8c8-91023fc951ca req-fbb2c35d-3a1d-4552-a3a2-11fa62f77360 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.803s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3d6dc7a0-6d73-4989-a8c8-91023fc951ca req-fbb2c35d-3a1d-4552-a3a2-11fa62f77360 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.628s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-547086209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5bab6b-7c39-4f45-bf52-3ed91d030e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:52Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Creating volume dd5bab6b-7c39-4f45-bf52-3ed91d030e23 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:57 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 1073741824 Jul 22 02:00:57 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727aabea-d7ec-41aa-8a77-01cc8898c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc', 'volume_size': 1, 'snapshot_id': '8be2c519-0242-48f0-b1da-80e763c985ac'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab5fa31-234b-4abf-99a8-61b1679b7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3d6dc7a0-6d73-4989-a8c8-91023fc951ca req-fbb2c35d-3a1d-4552-a3a2-11fa62f77360 tempest-AttachVolumeNegativeTest-739521749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-be520053-3c0b-4615-9987-c6cd75e62b19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1204aedd-449e-487d-9df1-b1648a8653aa', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:00:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Volume volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc (84b9463f-620b-4278-b6fa-26ea4a29c3dc): created successfully Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab5fa31-234b-4abf-99a8-61b1679b7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Flow 'volume_create_manager' (2cfedc02-6c9a-4bd6-aa04-a32c35f44fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-175a7998-3e46-4892-9130-f4b0a5bf2289 tempest-VolumesSnapshotTestJSON-24533531 None] Created volume successfully. Jul 22 02:00:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3d6dc7a0-6d73-4989-a8c8-91023fc951ca req-fbb2c35d-3a1d-4552-a3a2-11fa62f77360 tempest-AttachVolumeNegativeTest-739521749 None] attachment_update completed successfully. Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-84b9463f-620b-4278-b6fa-26ea4a29c3dc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-84b9463f-620b-4278-b6fa-26ea4a29c3dc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:00:57 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 1073741824" returned: 0 in 0.598s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab97ec1-b84f-4c77-a8d8-9b408f119cff]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:00:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:58 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 Jul 22 02:00:58 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:58 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc Jul 22 02:00:58 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:58 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562e0e38-9999-4005-b506-b76b85444fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87661366-ae47-4485-b848-30ff4f1646ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Volume volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 (dd5bab6b-7c39-4f45-bf52-3ed91d030e23): created successfully Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87661366-ae47-4485-b848-30ff4f1646ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (d6c3814e-8aa3-44e4-bbf1-1b7d4d003f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0b63ffb2-6a7b-45f3-99a4-398b47caa437 tempest-VolumesListAdminTestJSON-1892830039 None] Created volume successfully. Jul 22 02:00:58 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc" returned: 0 in 0.615s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:58 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc Jul 22 02:00:58 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:58 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-84b9463f-620b-4278-b6fa-26ea4a29c3dc" returned: 0 in 0.390s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-84b9463f-620b-4278-b6fa-26ea4a29c3dc" released by "delete_volume" :: held 1.112s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['baf9c108-d1f1-4210-9d70-f8463f989497', '1d1332f2-644a-4b9b-b435-815c685f5377', '5eec00a8-a8f3-4dea-9db4-db5d2796fc76', 'e3d60bc2-cdbe-4c7d-bcf6-85a6a82f7ae9'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:59 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:00:59 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (31c97f0f-079d-4c1e-b7fe-35abb84e86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c424df19-eb12-4573-884d-59fd3d87cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c424df19-eb12-4573-884d-59fd3d87cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1336611146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80588579-9b6c-4106-9b70-cac945604fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:59Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57676881-2e22-43e3-8ca3-37f2a46a6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:59 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57676881-2e22-43e3-8ca3-37f2a46a6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42a2661-0000-4ed4-bf06-a1b0d85efc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42a2661-0000-4ed4-bf06-a1b0d85efc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80588579-9b6c-4106-9b70-cac945604fc8', 'volume_name': 'volume-80588579-9b6c-4106-9b70-cac945604fc8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f1145d-19a1-4b22-a962-39137bedef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f1145d-19a1-4b22-a962-39137bedef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e5b367-22fc-44c2-91bc-b5bda9a25803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:00:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Volume 80588579-9b6c-4106-9b70-cac945604fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80588579-9b6c-4106-9b70-cac945604fc8', 'volume_size': 1} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1336611146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80588579-9b6c-4106-9b70-cac945604fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa61725c8ddf4b29955543a043e6cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:00:59Z,use_quota=True,user_id='a107f97653024fc8b85b51c2872e1056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Creating volume 80588579-9b6c-4106-9b70-cac945604fc8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:00:59 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.391s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:00:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Deleted volume successfully. Jul 22 02:00:59 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 1073741824 Jul 22 02:00:59 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:00:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3cc5ba80-9ca1-4b32-aa44-7033771964ce tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-84b9463f-620b-4278-b6fa-26ea4a29c3dc-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:00 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 1073741824" returned: 0 in 0.700s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-8be2c519-0242-48f0-b1da-80e763c985ac-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-8be2c519-0242-48f0-b1da-80e763c985ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Deleting offline snapshot 8be2c519-0242-48f0-b1da-80e763c985ac of volume 0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:01:00 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 Jul 22 02:01:00 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] snapshot_file for this snap is: volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94c7ec9-5712-4f3e-bd78-8a8c1b2e41b0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:00 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:01:00 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:00 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8" returned: 0 in 0.453s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e5b367-22fc-44c2-91bc-b5bda9a25803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80588579-9b6c-4106-9b70-cac945604fc8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59e8b3a-908e-4b1f-b0c3-5ddaab4e4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Volume volume-80588579-9b6c-4106-9b70-cac945604fc8 (80588579-9b6c-4106-9b70-cac945604fc8): created successfully Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59e8b3a-908e-4b1f-b0c3-5ddaab4e4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Flow 'volume_create_manager' (31c97f0f-079d-4c1e-b7fe-35abb84e86be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-551acd79-7e34-429b-88af-5e91554f705e tempest-VolumesListAdminTestJSON-1892830039 None] Created volume successfully. Jul 22 02:01:01 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.575s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade072e-b680-46d5-97c8-2118a51075b8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:01 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:01:01 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-c30e9654-90c7-4878-9ff9-b3030f2bf46a req-cc6aa0c2-ef3c-44a9-bb17-ee820157af63 tempest-AttachVolumeNegativeTest-739521749 None] Terminate volume connection completed successfully. Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-c30e9654-90c7-4878-9ff9-b3030f2bf46a req-cc6aa0c2-ef3c-44a9-bb17-ee820157af63 tempest-AttachVolumeNegativeTest-739521749 None] Deleting attachment 1204aedd-449e-487d-9df1-b1648a8653aa. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:01:01 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:01 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:01:01 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:01 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:01 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac Jul 22 02:01:01 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:02 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e.8be2c519-0242-48f0-b1da-80e763c985ac" returned: 0 in 0.359s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-8be2c519-0242-48f0-b1da-80e763c985ac" released by "_delete_snapshot" :: held 1.927s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" released by "delete_snapshot" :: held 1.963s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Flow 'volume_create_manager' (cb099045-baab-4625-b0fb-9b21f4096042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0537670e-5231-49e1-a7db-d6456ea5d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0537670e-5231-49e1-a7db-d6456ea5d307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda77364-3d27-4fd1-88f4-b98b0da76964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17080c6a3fa64104ad8727904664891e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:02Z,use_quota=True,user_id='5bc263cc55fd4f38a55a98e15b1d1a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df45f452-fe14-45f3-aae5-2185cb4e214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df45f452-fe14-45f3-aae5-2185cb4e214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf3cb4-2c75-42e3-a255-0923e65679fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bf3cb4-2c75-42e3-a255-0923e65679fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda77364-3d27-4fd1-88f4-b98b0da76964', 'volume_name': 'volume-eda77364-3d27-4fd1-88f4-b98b0da76964', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3df2f9-aaab-4c46-b7c8-95a6884b8151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3df2f9-aaab-4c46-b7c8-95a6884b8151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2036c7-852d-4683-a381-6956715f1cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:02 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Volume eda77364-3d27-4fd1-88f4-b98b0da76964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda77364-3d27-4fd1-88f4-b98b0da76964', 'volume_size': 1} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda77364-3d27-4fd1-88f4-b98b0da76964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17080c6a3fa64104ad8727904664891e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:02Z,use_quota=True,user_id='5bc263cc55fd4f38a55a98e15b1d1a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Creating volume eda77364-3d27-4fd1-88f4-b98b0da76964 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:02 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['cfd943e7-bcaa-4386-8959-5da15abc3a2e', 'fb760114-5fab-470b-b269-a2cdbe97e8b4', 'fc4d3516-d068-496b-8d06-46fbe444f5ae', '8382eca1-a927-44fb-8c98-c0bde84b1ca6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:02 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 1073741824 Jul 22 02:01:02 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Delete snapshot completed successfully. Jul 22 02:01:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8eaedce2-78df-47f0-8f72-c0d30f2aa79f tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-8be2c519-0242-48f0-b1da-80e763c985ac-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:03 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 1073741824" returned: 0 in 0.758s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:03 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 Jul 22 02:01:03 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:03 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964" returned: 0 in 0.320s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2036c7-852d-4683-a381-6956715f1cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda77364-3d27-4fd1-88f4-b98b0da76964', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29874dd-2e25-4697-8756-f083d30cba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-0dff1fa9-8dad-4aa0-9714-cde75a60518e-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:03 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Volume volume-eda77364-3d27-4fd1-88f4-b98b0da76964 (eda77364-3d27-4fd1-88f4-b98b0da76964): created successfully Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29874dd-2e25-4697-8756-f083d30cba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Flow 'volume_create_manager' (cb099045-baab-4625-b0fb-9b21f4096042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-0dff1fa9-8dad-4aa0-9714-cde75a60518e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4de33b20-66d7-44de-a933-1365df902fc6 tempest-VolumesListAdminTestJSON-1712520365 None] Created volume successfully. Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f1519-5efc-404e-be0a-4ffc90ea7b9a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:04 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:01:04 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:04 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.570s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:04 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e Jul 22 02:01:04 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Acquiring lock "cinder-eda77364-3d27-4fd1-88f4-b98b0da76964-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "cinder-eda77364-3d27-4fd1-88f4-b98b0da76964-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Acquiring lock "cinder-quobyte-eda77364-3d27-4fd1-88f4-b98b0da76964" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "cinder-quobyte-eda77364-3d27-4fd1-88f4-b98b0da76964" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[db800d30-00d3-4d11-96fa-be89a634e0c4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-80588579-9b6c-4106-9b70-cac945604fc8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-80588579-9b6c-4106-9b70-cac945604fc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-quobyte-80588579-9b6c-4106-9b70-cac945604fc8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-80588579-9b6c-4106-9b70-cac945604fc8" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:05 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0dff1fa9-8dad-4aa0-9714-cde75a60518e" returned: 0 in 0.532s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:05 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 Jul 22 02:01:05 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52190e-f7b4-4307-a4a5-b57c2b590f78]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-0dff1fa9-8dad-4aa0-9714-cde75a60518e" released by "delete_volume" :: held 1.205s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['0d012b36-82f0-468f-800f-a366b8ec6b17', 'b1d4c3b3-b7e9-4c72-a79f-a8bef83ae892', '259ca6e4-2030-44bc-88dc-6bae792fd105', '3171b305-1808-40b9-9828-dfe9bcf624a5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:05 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 Jul 22 02:01:05 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:05 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:05 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:05 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964" returned: 0 in 0.567s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:05 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964 Jul 22 02:01:05 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:05 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:05 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8" returned: 0 in 0.492s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Deleted volume successfully. Jul 22 02:01:05 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8 Jul 22 02:01:05 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-76385e33-8a9f-42c1-857e-2b5da384d982 tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-0dff1fa9-8dad-4aa0-9714-cde75a60518e-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:05 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eda77364-3d27-4fd1-88f4-b98b0da76964" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "cinder-quobyte-eda77364-3d27-4fd1-88f4-b98b0da76964" released by "delete_volume" :: held 0.927s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Created reservations ['7b1c1d47-3066-433f-85e2-854fa7f67ce2', 'be77c507-2d8f-4c3c-8c3a-feaa4050d77e', 'f4e1d731-c280-42e6-b378-3559c12b7be7', 'c59d375a-3a27-4375-b889-f3a48e839794'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:06 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:06 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:06 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80588579-9b6c-4106-9b70-cac945604fc8" returned: 0 in 0.342s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-80588579-9b6c-4106-9b70-cac945604fc8" released by "delete_volume" :: held 0.914s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Created reservations ['fbb2402f-69ef-4b6a-95e0-7f7d69b4eeb3', '9822c82a-9258-4bfc-b884-b68dad55e6ca', '6cbb7ed3-5e6b-45a5-a510-c92a5d43b90c', 'b062657f-adcd-4f4c-a28c-6162ba8479ae'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-3304f83a-fac9-4f98-ac8d-825d7054ff8e-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:06 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-3304f83a-fac9-4f98-ac8d-825d7054ff8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:06 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:06 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.485s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Deleted volume successfully. Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38464e25-8bdd-43ea-83fa-d4fba3715352 tempest-VolumesListAdminTestJSON-1712520365 None] Lock "cinder-eda77364-3d27-4fd1-88f4-b98b0da76964-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb63f10-468a-42ac-9326-fabf8dafc94f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:06 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e Jul 22 02:01:06 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:06 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.370s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Deleted volume successfully. Jul 22 02:01:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c9f882e9-1c7c-473a-b298-67c406d515b4 tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-80588579-9b6c-4106-9b70-cac945604fc8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:06 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e" returned: 0 in 0.418s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:07 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e Jul 22 02:01:07 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-be520053-3c0b-4615-9987-c6cd75e62b19-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-be520053-3c0b-4615-9987-c6cd75e62b19-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-quobyte-be520053-3c0b-4615-9987-c6cd75e62b19" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-be520053-3c0b-4615-9987-c6cd75e62b19" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a312d-25c6-43b2-bf86-3e9b00a30928]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:07 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3304f83a-fac9-4f98-ac8d-825d7054ff8e" returned: 0 in 0.313s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:07 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 Jul 22 02:01:07 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-quobyte-3304f83a-fac9-4f98-ac8d-825d7054ff8e" released by "delete_volume" :: held 0.839s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Created reservations ['5f9d59fb-5e70-412d-9425-89df54a63664', '2eb27e3f-508b-4bfa-89e4-ceef6c7545fa', '44341b74-3e9c-45a0-974e-523bac5c7302', '65934ee5-5b5b-4cd7-9089-2aff5a4a6d5f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:07 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:07 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:07 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:07 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19 Jul 22 02:01:07 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-dd5bab6b-7c39-4f45-bf52-3ed91d030e23-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-dd5bab6b-7c39-4f45-bf52-3ed91d030e23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-quobyte-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788bb0a-a2ba-4b47-b2bd-317b40b99d4d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:07 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.489s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:07 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Deleted volume successfully. Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:08 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 Jul 22 02:01:08 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Flow 'volume_create_manager' (e0bbc890-4814-4e22-a3e0-86e5eeaaa6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59239d46-94c7-41e9-be21-81ca390f1ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:08 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be520053-3c0b-4615-9987-c6cd75e62b19" returned: 0 in 0.473s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59239d46-94c7-41e9-be21-81ca390f1ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-467324728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a566ce-d539-4c3c-837c-0220758bb6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce94e2e20da4757b83dd970154bf040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:08Z,use_quota=True,user_id='98a9a19d19874b4baf50f4bde9c90fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55649f35-315d-4e30-82a6-2303ebc5f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55649f35-315d-4e30-82a6-2303ebc5f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a995a9-1d12-415c-b17e-a0c281eaa242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a995a9-1d12-415c-b17e-a0c281eaa242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a566ce-d539-4c3c-837c-0220758bb6f8', 'volume_name': 'volume-d7a566ce-d539-4c3c-837c-0220758bb6f8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7a4342-8036-474f-995b-1ac6eb4dc1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7a4342-8036-474f-995b-1ac6eb4dc1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1011b-230b-4f1f-be06-4a4ed54ee577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:08 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Volume d7a566ce-d539-4c3c-837c-0220758bb6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a566ce-d539-4c3c-837c-0220758bb6f8', 'volume_size': 1} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-467324728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a566ce-d539-4c3c-837c-0220758bb6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce94e2e20da4757b83dd970154bf040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:08Z,use_quota=True,user_id='98a9a19d19874b4baf50f4bde9c90fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Creating volume d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:08 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:08 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 1073741824 Jul 22 02:01:08 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6f8bfcaf-0165-4c23-919b-98cd193328aa tempest-VolumesSnapshotTestJSON-24533531 None] Lock "cinder-3304f83a-fac9-4f98-ac8d-825d7054ff8e-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-be520053-3c0b-4615-9987-c6cd75e62b19" released by "delete_volume" :: held 1.098s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Created reservations ['e40837db-24c3-43b1-ba76-2e5440c96251', 'ddc69f92-e1f2-4d9f-806d-1cadf7267311', 'bef061e5-9076-497f-9cb1-5007d1754b56', '6b82d521-f62d-4834-a727-c0450685da6a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:08 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" returned: 0 in 0.549s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:08 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:08 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:08 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23 Jul 22 02:01:08 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:08 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 1073741824" returned: 0 in 0.535s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:08 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" returned: 0 in 0.321s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-dd5bab6b-7c39-4f45-bf52-3ed91d030e23" released by "delete_volume" :: held 0.944s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:08 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Deleted volume successfully. Jul 22 02:01:08 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:01:08 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9336f86f-7b3c-420e-89b1-14172781b759 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-be520053-3c0b-4615-9987-c6cd75e62b19-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:08 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Created reservations ['3e37ae3b-e687-4887-a231-4fe0cef416f0', 'f1587bc2-6aba-4275-8b42-302fd2d82a17', '7b910bb3-847b-4b5c-8de6-c14568515bb2', '1f66e596-fec9-49ee-b63f-34e0c363006c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:09 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:09 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:09 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.400s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1011b-230b-4f1f-be06-4a4ed54ee577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a566ce-d539-4c3c-837c-0220758bb6f8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d477c-d445-4f04-8e27-9c1f47dda97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:09 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Volume volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 (d7a566ce-d539-4c3c-837c-0220758bb6f8): created successfully Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d477c-d445-4f04-8e27-9c1f47dda97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Flow 'volume_create_manager' (e0bbc890-4814-4e22-a3e0-86e5eeaaa6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a7291e5d-a104-4b94-8527-522e8621a6cf tempest-TestStampPattern-1844322949 None] Created volume successfully. Jul 22 02:01:09 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-f28e9d4a-acf1-4793-a2a9-05c0d418715c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.420s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Deleted volume successfully. Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-f28e9d4a-acf1-4793-a2a9-05c0d418715c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-68d6b429-5568-4d03-a593-26d1ab59115c tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-dd5bab6b-7c39-4f45-bf52-3ed91d030e23-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-quobyte-f28e9d4a-acf1-4793-a2a9-05c0d418715c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-f28e9d4a-acf1-4793-a2a9-05c0d418715c" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92efa5b-0b43-4036-a5bf-acd91f177495]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:09 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c Jul 22 02:01:09 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:10 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:10 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c Jul 22 02:01:10 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-c0c61127-a730-435c-a81a-40acca59022c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-c0c61127-a730-435c-a81a-40acca59022c-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "cinder-quobyte-c0c61127-a730-435c-a81a-40acca59022c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-c0c61127-a730-435c-a81a-40acca59022c" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[206aac79-27e4-45fd-98d7-de28030fc8fa]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:10 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f28e9d4a-acf1-4793-a2a9-05c0d418715c" returned: 0 in 0.345s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-f28e9d4a-acf1-4793-a2a9-05c0d418715c" released by "delete_volume" :: held 0.849s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Created reservations ['b503d15d-4d9f-40af-a0d9-3d84a0ad36f8', 'aeb39898-f625-4dfd-8411-97925839a86f', 'b3d150a7-54b1-482a-b47a-55c3b40e65bf', 'c6fef28c-acd5-4e3c-a7f6-cde9c9058a1f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:10 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c Jul 22 02:01:10 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:10 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:10 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:11 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c" returned: 0 in 0.663s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:11 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:11 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c Jul 22 02:01:11 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Deleted volume successfully. Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-99a22b73-81a0-4861-a844-c73f09735657 tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-f28e9d4a-acf1-4793-a2a9-05c0d418715c-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:11 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c0c61127-a730-435c-a81a-40acca59022c" returned: 0 in 0.413s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-quobyte-c0c61127-a730-435c-a81a-40acca59022c" released by "delete_volume" :: held 1.131s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Created reservations ['15350a01-c52d-4da0-bca9-9572a83c72a2', '4b4e7be2-4453-4816-9eed-32603208d832', '4a7d2881-1261-4e81-a096-f43ecb56b363', 'd34eb3e8-48e6-419e-ad82-2e2215edda3f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:11 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:11 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:12 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.420s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Deleted volume successfully. Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-296c2776-c322-41ba-b39e-5df959618ddb-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d53d80b0-0c19-4604-a5a2-253170e6bc7d tempest-VolumesListAdminTestJSON-1892830039 None] Lock "cinder-c0c61127-a730-435c-a81a-40acca59022c-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-296c2776-c322-41ba-b39e-5df959618ddb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "cinder-quobyte-296c2776-c322-41ba-b39e-5df959618ddb" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-296c2776-c322-41ba-b39e-5df959618ddb" acquired by "delete_volume" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14e4e0-3d1c-4132-9be7-0bf2b2060d97]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:12 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb Jul 22 02:01:12 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:12 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb" returned: 0 in 0.477s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:12 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb Jul 22 02:01:12 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:13 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-296c2776-c322-41ba-b39e-5df959618ddb" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-quobyte-296c2776-c322-41ba-b39e-5df959618ddb" released by "delete_volume" :: held 0.893s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Created reservations ['167d9de2-7825-441e-9e5f-90bfb698f13f', '61e286d8-5035-42ea-a759-b17c7761213f', '6bec794d-1ced-4dd3-8a71-1c7e34c6cf51', '62fb46df-e114-4e9d-b486-13977a88351f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:13 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:13 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:13 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Deleted volume successfully. Jul 22 02:01:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4149cb4d-fde0-42ef-9768-e18a7af0e58b tempest-AttachVolumeNegativeTest-739521749 None] Lock "cinder-296c2776-c322-41ba-b39e-5df959618ddb-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Flow 'volume_create_manager' (53f8402c-e0a2-4917-94ce-aecbb310226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ef892-a3ab-41c8-a0a7-301d19019d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6ef892-a3ab-41c8-a0a7-301d19019d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1930978137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ba4fa5-4bef-46f4-bca4-449435c1509d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b059a8562d1242919e673e9ab359caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:19Z,use_quota=True,user_id='a54e1e51b61e4229b2d9fbe5edbe0cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce859220-e4c4-446b-8389-f97ed3a7d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce859220-e4c4-446b-8389-f97ed3a7d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1976f8e0-1889-460f-8391-cf9fd4ca9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1976f8e0-1889-460f-8391-cf9fd4ca9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ba4fa5-4bef-46f4-bca4-449435c1509d', 'volume_name': 'volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d', 'volume_size': 2}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cefb81-a4ca-4e14-9720-050402dbc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24cefb81-a4ca-4e14-9720-050402dbc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59023f0b-e41e-4bdb-9459-ff53b21e3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Volume d9ba4fa5-4bef-46f4-bca4-449435c1509d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d', 'volume_size': 2} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1930978137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ba4fa5-4bef-46f4-bca4-449435c1509d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b059a8562d1242919e673e9ab359caa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:19Z,use_quota=True,user_id='a54e1e51b61e4229b2d9fbe5edbe0cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Creating volume d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:19 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d 2147483648 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:19 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d 2147483648 Jul 22 02:01:19 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:20 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d 2147483648" returned: 0 in 0.917s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:20 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d Jul 22 02:01:20 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:20 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59023f0b-e41e-4bdb-9459-ff53b21e3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d', 'volume_size': 2}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4787c10f-61c0-4a98-9ea0-82e683373e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Flow 'volume_create_manager' (ced7ef38-521d-4285-a08d-adadfe007d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad49f82-4b24-472f-b810-c3df62350cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Volume volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d (d9ba4fa5-4bef-46f4-bca4-449435c1509d): created successfully Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4787c10f-61c0-4a98-9ea0-82e683373e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Flow 'volume_create_manager' (53f8402c-e0a2-4917-94ce-aecbb310226f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad49f82-4b24-472f-b810-c3df62350cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-772549222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41909d1e-fc43-42a3-9796-dc7784f05a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb445f41650467fa057e78f43ef5389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:21Z,use_quota=True,user_id='8d2851df966444faa0728dbd38c84b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c254a3-91a5-4eb6-b824-39502c964024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c254a3-91a5-4eb6-b824-39502c964024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7caaa7-f708-4c13-9c91-7f4e520ee411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:20 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:01:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-901cc6f9-1fa8-499e-b06a-b76d603535f7 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Created volume successfully. Jul 22 02:01:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Creating offline snapshot c1107bde-0569-4556-9e22-0493d2fbcd92 of volume d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:01:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09f4ef-85e9-4041-a283-46a2e7ddd652]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:22 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d Jul 22 02:01:22 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7caaa7-f708-4c13-9c91-7f4e520ee411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41909d1e-fc43-42a3-9796-dc7784f05a6e', 'volume_name': 'volume-41909d1e-fc43-42a3-9796-dc7784f05a6e', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea29b6f-05fe-4f9b-83af-e3a56eaeeb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea29b6f-05fe-4f9b-83af-e3a56eaeeb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8b663-60e7-4e37-b535-4c9efcd6e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Volume 41909d1e-fc43-42a3-9796-dc7784f05a6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41909d1e-fc43-42a3-9796-dc7784f05a6e', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Trying to clone 41909d1e-fc43-42a3-9796-dc7784f05a6e from image 24473c99-a605-4f38-8ab8-40745fe15ef5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:01:22 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d" returned: 0 in 0.803s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 2G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:22 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 2G Jul 22 02:01:22 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:01:22 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Image download 20.69 MB at 20.69 MB/s Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f124918-fa03-4d75-a3fb-c1cc00de0200]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:23 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD Jul 22 02:01:23 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:23 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 2G" returned: 0 in 0.706s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:23 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 is fetched for user 8d2851df966444faa0728dbd38c84b13. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:01:23 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 Jul 22 02:01:23 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f13c221-cd1d-4b8c-940f-2f2a372b0a61]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:23 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD Jul 22 02:01:23 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:23 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92" returned: 0 in 0.644s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:23 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 is being set with open permissions: ugo+rw Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:24 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 Jul 22 02:01:24 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:24 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:24 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92" returned: 0 in 0.418s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:24 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info Jul 22 02:01:24 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:24 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:24 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info is being set with open permissions: ugo+rw Jul 22 02:01:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:24 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info Jul 22 02:01:24 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:25 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.info" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-772549222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41909d1e-fc43-42a3-9796-dc7784f05a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb445f41650467fa057e78f43ef5389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:21Z,use_quota=True,user_id='8d2851df966444faa0728dbd38c84b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Creating volume 41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:25 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:25 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1073741824 Jul 22 02:01:25 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-03fd2b60-0edf-443c-9a34-b8d3c39b9b2f tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Create snapshot completed successfully Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Flow 'volume_create_manager' (a3e6f1d6-b9c2-43c4-b1ba-c8c7e56af286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710cf951-aa73-49c7-8c7f-69eb11989b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710cf951-aa73-49c7-8c7f-69eb11989b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-729200570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26b21f5-ece4-4d27-915e-3169da791666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6bd216f73ca54c2d92292cbf82f49a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:26Z,use_quota=True,user_id='abad80fbb6e4477daa812f9c5a476ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b717e84-c19b-4d7e-9ee3-57773445877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b717e84-c19b-4d7e-9ee3-57773445877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cae9013-371f-470e-aa4b-2c180d11fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cae9013-371f-470e-aa4b-2c180d11fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26b21f5-ece4-4d27-915e-3169da791666', 'volume_name': 'volume-e26b21f5-ece4-4d27-915e-3169da791666', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b36cd7-4317-496a-9289-1b325985b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b36cd7-4317-496a-9289-1b325985b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb890a-b6f1-471a-a5e6-747bb6c4e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Volume e26b21f5-ece4-4d27-915e-3169da791666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26b21f5-ece4-4d27-915e-3169da791666', 'volume_size': 1} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:25 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1073741824" returned: 0 in 0.687s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:25 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e Jul 22 02:01:25 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "cinder-c1107bde-0569-4556-9e22-0493d2fbcd92-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-c1107bde-0569-4556-9e22-0493d2fbcd92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "cinder-quobyte-c1107bde-0569-4556-9e22-0493d2fbcd92" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:26 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e" returned: 0 in 0.392s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-729200570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26b21f5-ece4-4d27-915e-3169da791666,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6bd216f73ca54c2d92292cbf82f49a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:26Z,use_quota=True,user_id='abad80fbb6e4477daa812f9c5a476ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Creating volume e26b21f5-ece4-4d27-915e-3169da791666 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-c1107bde-0569-4556-9e22-0493d2fbcd92" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Deleting offline snapshot c1107bde-0569-4556-9e22-0493d2fbcd92 of volume d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:01:26 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 1073741824 Jul 22 02:01:26 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] snapshot_file for this snap is: volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Attempting download of 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 41909d1e-fc43-42a3-9796-dc7784f05a6e. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b9f4a-7da2-45ef-a58a-317ca7ae9b17]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7436b5-8534-47a2-8e40-183f598673ed]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:26 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 Jul 22 02:01:26 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:26 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc Jul 22 02:01:26 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:26 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 1073741824" returned: 0 in 0.642s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:26 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc" returned: 0 in 0.501s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 Jul 22 02:01:27 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92" returned: 0 in 0.683s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c744f2-a41e-454d-b848-f9b644fceda9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc Jul 22 02:01:27 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d Jul 22 02:01:27 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666" returned: 0 in 0.359s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cb890a-b6f1-471a-a5e6-747bb6c4e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26b21f5-ece4-4d27-915e-3169da791666', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c21d08d-d116-404d-af28-aca7649abd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Volume volume-e26b21f5-ece4-4d27-915e-3169da791666 (e26b21f5-ece4-4d27-915e-3169da791666): created successfully Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c21d08d-d116-404d-af28-aca7649abd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Flow 'volume_create_manager' (a3e6f1d6-b9c2-43c4-b1ba-c8c7e56af286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-cf18eeff-c484-480f-af6f-5bc85e2dc0d2 req-3120d2c0-4b4d-4816-b53f-ecefbe64de29 tempest-VolumesGetTestJSON-257394727 None] Created volume successfully. Jul 22 02:01:27 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc" returned: 1 in 0.494s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_mca27agc' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f46c779-1955-4575-afc8-eb68e42e6769]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 Jul 22 02:01:27 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD Jul 22 02:01:27 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] 24473c99-a605-4f38-8ab8-40745fe15ef5 was qcow2, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:27 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e Jul 22 02:01:27 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:27 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92 Jul 22 02:01:27 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Acquiring lock "cinder-e26b21f5-ece4-4d27-915e-3169da791666-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "cinder-e26b21f5-ece4-4d27-915e-3169da791666-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Acquiring lock "cinder-quobyte-e26b21f5-ece4-4d27-915e-3169da791666" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "cinder-quobyte-e26b21f5-ece4-4d27-915e-3169da791666" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d75b2-f8fa-4540-9dab-4de3e7af29cc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:28 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d.c1107bde-0569-4556-9e22-0493d2fbcd92" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-c1107bde-0569-4556-9e22-0493d2fbcd92" released by "_delete_snapshot" :: held 2.103s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" released by "delete_snapshot" :: held 2.172s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:28 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 Jul 22 02:01:28 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Created reservations ['6e6e3c47-6220-4892-8f90-6e2a716cf514', 'bbf30717-c292-4fe8-a808-a295518303be', '3803ddbe-a980-420a-b0d1-edf0643d13bc', 'c8e2216e-e75f-4c59-a82d-ca7218bcbf4a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Delete snapshot completed successfully. Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51d8ad77-2634-4d66-8f9a-f4ee9d87abce tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-c1107bde-0569-4556-9e22-0493d2fbcd92-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:28 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666" returned: 0 in 0.435s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:28 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666 Jul 22 02:01:28 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:29 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e26b21f5-ece4-4d27-915e-3169da791666" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "cinder-quobyte-e26b21f5-ece4-4d27-915e-3169da791666" released by "delete_volume" :: held 0.786s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.quota [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Created reservations ['600de273-03c0-428f-9020-0435f9894969', '04d5fbfa-a55f-412b-b7dc-4883e4ed83ef', 'cb9006c2-a2ae-43d7-be2c-0a0e4c595ba1', 'd7043b6a-acf7-4e85-843c-7e559d92d26f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:29 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:29 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "cinder-d9ba4fa5-4bef-46f4-bca4-449435c1509d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:29 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.manager [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-d9ba4fa5-4bef-46f4-bca4-449435c1509d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Deleted volume successfully. Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-80e2ceaa-d835-41e2-9f5f-f163584d222d req-05a82062-bc43-49cb-b826-722b26b3e812 tempest-VolumesGetTestJSON-257394727 None] Lock "cinder-e26b21f5-ece4-4d27-915e-3169da791666-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8534e11d-c0f4-4504-95a1-eae2680f3c70]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:29 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d Jul 22 02:01:29 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:30 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e" returned: 0 in 2.228s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_u3_3e9hqdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:01:30 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Converted 112.00 MB image at 50.23 MB/s Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:30 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1G Jul 22 02:01:30 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:30 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d" returned: 0 in 0.510s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:30 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d Jul 22 02:01:30 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:30 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e 1G" returned: 0 in 0.395s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Downloaded image 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 41909d1e-fc43-42a3-9796-dc7784f05a6e successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 for user 8d2851df966444faa0728dbd38c84b13 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Marking volume 41909d1e-fc43-42a3-9796-dc7784f05a6e as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Copying metadata from image 24473c99-a605-4f38-8ab8-40745fe15ef5 to 41909d1e-fc43-42a3-9796-dc7784f05a6e. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Creating volume glance metadata for volume 41909d1e-fc43-42a3-9796-dc7784f05a6e backed by image 24473c99-a605-4f38-8ab8-40745fe15ef5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c8b663-60e7-4e37-b535-4c9efcd6e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41909d1e-fc43-42a3-9796-dc7784f05a6e', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d53146b-b40d-46a6-82c7-725718b01727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Volume volume-41909d1e-fc43-42a3-9796-dc7784f05a6e (41909d1e-fc43-42a3-9796-dc7784f05a6e): created successfully Jul 22 02:01:30 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d53146b-b40d-46a6-82c7-725718b01727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Flow 'volume_create_manager' (ced7ef38-521d-4285-a08d-adadfe007d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d9ba4fa5-4bef-46f4-bca4-449435c1509d" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0d5fb4d1-bae4-45f6-92f8-98792d0f7955 tempest-VolumesImageMetadata-1307945900 None] Created volume successfully. Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-quobyte-d9ba4fa5-4bef-46f4-bca4-449435c1509d" released by "delete_volume" :: held 0.993s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Created reservations ['87a7e651-89b7-4b40-85d8-7e68cc5de668', '62a75b4d-aa22-410f-b8b1-102232cb2f8e', 'd9f5f43d-9884-4323-b7f7-820e473daaf1', '4f86de02-99ca-47ca-8de4-ec54f189319c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:30 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:31 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:31 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.287s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:31 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Deleted volume successfully. Jul 22 02:01:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-27a33be6-c463-49ed-bfa5-f927d9bf1797 tempest-VolumesSnapshotNegativeTestJSON-1545594191 None] Lock "cinder-d9ba4fa5-4bef-46f4-bca4-449435c1509d-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Acquiring lock "cinder-41909d1e-fc43-42a3-9796-dc7784f05a6e-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "cinder-41909d1e-fc43-42a3-9796-dc7784f05a6e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Acquiring lock "cinder-quobyte-41909d1e-fc43-42a3-9796-dc7784f05a6e" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "cinder-quobyte-41909d1e-fc43-42a3-9796-dc7784f05a6e" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5016031f-31a2-4074-a1ca-61b8dfea4061]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:32 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e Jul 22 02:01:32 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:32 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:32 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e Jul 22 02:01:32 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:33 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-41909d1e-fc43-42a3-9796-dc7784f05a6e" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "cinder-quobyte-41909d1e-fc43-42a3-9796-dc7784f05a6e" released by "delete_volume" :: held 0.766s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Created reservations ['49ba0bd4-63c4-478e-a649-927e3997e84a', 'dc19b580-6890-4227-9052-f86559c545ec', '2b541032-12fc-4aa5-b4b6-ea125cdb51c1', '2acb9ee2-90f6-4e27-a117-b496da9ea761'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:33 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:33 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:33 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.336s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Deleted volume successfully. Jul 22 02:01:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a8d26889-22c9-4d78-8fd5-6759a4ccbcd1 tempest-VolumesImageMetadata-1307945900 None] Lock "cinder-41909d1e-fc43-42a3-9796-dc7784f05a6e-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Flow 'volume_create_manager' (942b1c9c-a4ee-416f-bbab-5e5216d3bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56413b7-4edb-4d49-a68c-99385627f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56413b7-4edb-4d49-a68c-99385627f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1278931257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a4408-1185-4582-aa75-0dad9ad4a753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa49634c6034ea6b9aa40fa2e0af879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:39Z,use_quota=True,user_id='dd3cc97166a440c7ae46e22430a65a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08209960-0fc7-4955-91b5-6e20aa8e4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08209960-0fc7-4955-91b5-6e20aa8e4d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e0d8f0-f540-44bd-8104-d386aeee8906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e0d8f0-f540-44bd-8104-d386aeee8906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17a4408-1185-4582-aa75-0dad9ad4a753', 'volume_name': 'volume-e17a4408-1185-4582-aa75-0dad9ad4a753', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4835a2-d729-4882-b5a5-a92572e00096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4835a2-d729-4882-b5a5-a92572e00096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c453d6b-e6cb-4ff7-bd24-c016fcdc5515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:39 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Volume e17a4408-1185-4582-aa75-0dad9ad4a753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17a4408-1185-4582-aa75-0dad9ad4a753', 'volume_size': 1} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1278931257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a4408-1185-4582-aa75-0dad9ad4a753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa49634c6034ea6b9aa40fa2e0af879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:39Z,use_quota=True,user_id='dd3cc97166a440c7ae46e22430a65a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Creating volume e17a4408-1185-4582-aa75-0dad9ad4a753 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:39 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:39 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 1073741824 Jul 22 02:01:39 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:39 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 1073741824" returned: 0 in 0.531s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:39 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 Jul 22 02:01:39 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:40 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753" returned: 0 in 0.358s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c453d6b-e6cb-4ff7-bd24-c016fcdc5515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17a4408-1185-4582-aa75-0dad9ad4a753', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e90ca16-3b0c-4bcf-a7aa-40bd82636805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:40 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Volume volume-e17a4408-1185-4582-aa75-0dad9ad4a753 (e17a4408-1185-4582-aa75-0dad9ad4a753): created successfully Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e90ca16-3b0c-4bcf-a7aa-40bd82636805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Flow 'volume_create_manager' (942b1c9c-a4ee-416f-bbab-5e5216d3bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2bcc46c4-d40e-4d9d-a264-9ffb940b2167 tempest-VolumesTransfersTest-1271432887 None] Created volume successfully. Jul 22 02:01:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2fba9d44-4ac2-44ad-a191-4a780e32cf57 tempest-VolumesTransfersTest-191302049 None] Transfer volume completed successfully. Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Acquiring lock "cinder-e17a4408-1185-4582-aa75-0dad9ad4a753-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "cinder-e17a4408-1185-4582-aa75-0dad9ad4a753-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Acquiring lock "cinder-quobyte-e17a4408-1185-4582-aa75-0dad9ad4a753" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "cinder-quobyte-e17a4408-1185-4582-aa75-0dad9ad4a753" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d845626e-63f4-43fa-ae5f-9d5d6ce16a0d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:43 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 Jul 22 02:01:43 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:43 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753" returned: 0 in 0.514s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:43 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753 Jul 22 02:01:43 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:43 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e17a4408-1185-4582-aa75-0dad9ad4a753" returned: 0 in 0.299s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "cinder-quobyte-e17a4408-1185-4582-aa75-0dad9ad4a753" released by "delete_volume" :: held 0.873s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Created reservations ['87aac6b5-83a6-4bd9-89d7-637d5635c3bd', '79cf70a3-c25c-4178-8f6c-81e7c9fda931', 'be685833-2605-4d9b-9a6f-6408e6be24cb', '016cfad2-3e88-4df6-b7e6-e18c29e6fb7f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:43 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:43 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:44 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:44 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Deleted volume successfully. Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-63fdc3a0-8057-48ae-8d2d-70d16dd6ada0 tempest-VolumesTransfersTest-544423101 None] Lock "cinder-e17a4408-1185-4582-aa75-0dad9ad4a753-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Flow 'volume_create_manager' (a1d2212f-1cc1-4f6c-86c9-57aac639997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bee07ba-aa64-4bbc-92bd-530a0896c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bee07ba-aa64-4bbc-92bd-530a0896c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1422040499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dfb27f-d34a-4697-a160-4f17b7de5f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa49634c6034ea6b9aa40fa2e0af879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:45Z,use_quota=True,user_id='dd3cc97166a440c7ae46e22430a65a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3bba01-6b93-49a2-a383-c8ee0a27eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3bba01-6b93-49a2-a383-c8ee0a27eb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e930708e-173b-4ce5-bdcf-4451f3fca614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e930708e-173b-4ce5-bdcf-4451f3fca614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dfb27f-d34a-4697-a160-4f17b7de5f39', 'volume_name': 'volume-02dfb27f-d34a-4697-a160-4f17b7de5f39', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c21bcb-0e31-496b-b263-6025a0b436e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c21bcb-0e31-496b-b263-6025a0b436e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e1a93d-3df4-4364-a4e7-60e6a75a4d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:44 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Volume 02dfb27f-d34a-4697-a160-4f17b7de5f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dfb27f-d34a-4697-a160-4f17b7de5f39', 'volume_size': 1} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1422040499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dfb27f-d34a-4697-a160-4f17b7de5f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa49634c6034ea6b9aa40fa2e0af879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:45Z,use_quota=True,user_id='dd3cc97166a440c7ae46e22430a65a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Creating volume 02dfb27f-d34a-4697-a160-4f17b7de5f39 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:44 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:44 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 1073741824 Jul 22 02:01:44 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:45 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 1073741824" returned: 0 in 0.583s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:45 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 Jul 22 02:01:45 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:45 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39" returned: 0 in 0.366s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e1a93d-3df4-4364-a4e7-60e6a75a4d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dfb27f-d34a-4697-a160-4f17b7de5f39', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b1961d-a0df-4abe-acc0-494643711946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=126,cinder:UPDATE=177,cinder:INSERT=43,cinder:DELETE=7 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:01:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Volume volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 (02dfb27f-d34a-4697-a160-4f17b7de5f39): created successfully Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b1961d-a0df-4abe-acc0-494643711946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Flow 'volume_create_manager' (a1d2212f-1cc1-4f6c-86c9-57aac639997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=151,cinder:SELECT=130,cinder:INSERT=47,cinder:DELETE=20 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:01:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d61c752f-be6a-46c9-9d1c-6493abae7eea tempest-VolumesTransfersTest-1271432887 None] Created volume successfully. Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-890dd506-e911-4126-b934-0f9cad70674b req-4bf3a32a-9bf7-4676-a372-2ed347d42729 tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-890dd506-e911-4126-b934-0f9cad70674b req-4bf3a32a-9bf7-4676-a372-2ed347d42729 tempest-TestStampPattern-1844322949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-890dd506-e911-4126-b934-0f9cad70674b req-4bf3a32a-9bf7-4676-a372-2ed347d42729 tempest-TestStampPattern-1844322949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-890dd506-e911-4126-b934-0f9cad70674b req-4bf3a32a-9bf7-4676-a372-2ed347d42729 tempest-TestStampPattern-1844322949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-d7a566ce-d539-4c3c-837c-0220758bb6f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20eacbc9-d9ce-4ca9-971f-38ef41717bb2', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:01:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-890dd506-e911-4126-b934-0f9cad70674b req-4bf3a32a-9bf7-4676-a372-2ed347d42729 tempest-TestStampPattern-1844322949 None] attachment_update completed successfully. Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Acquiring lock "cinder-02dfb27f-d34a-4697-a160-4f17b7de5f39-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "cinder-02dfb27f-d34a-4697-a160-4f17b7de5f39-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Acquiring lock "cinder-quobyte-02dfb27f-d34a-4697-a160-4f17b7de5f39" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "cinder-quobyte-02dfb27f-d34a-4697-a160-4f17b7de5f39" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08c6de-47e6-4792-9aba-bdbdc1bf98ba]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:47 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 Jul 22 02:01:47 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:48 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39" returned: 0 in 0.683s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:48 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39 Jul 22 02:01:48 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:48 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-02dfb27f-d34a-4697-a160-4f17b7de5f39" returned: 0 in 0.359s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "cinder-quobyte-02dfb27f-d34a-4697-a160-4f17b7de5f39" released by "delete_volume" :: held 1.111s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Created reservations ['a5974701-81ad-48cf-b02a-f9dadbf9eb9d', '9244c9f1-a17b-4379-b177-ba40003cbb0f', '881ecddd-3359-4163-a4bf-fb304fa4f3fc', 'f48e3f33-415e-4ee6-9c0d-038f3064f69c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:48 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:48 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:49 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:49 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Deleted volume successfully. Jul 22 02:01:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-72d851d5-9234-4eec-9b40-9d7a2ec7db9c tempest-VolumesTransfersTest-544423101 None] Lock "cinder-02dfb27f-d34a-4697-a160-4f17b7de5f39-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:52 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:52 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:52 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.423s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:01:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Flow 'volume_create_manager' (de291f1e-488d-47e3-af9d-5e04a8ecb214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a69d2-fe75-4f55-a76e-bc5247d58022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a69d2-fe75-4f55-a76e-bc5247d58022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1114132908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15b810-f9d0-4262-b6d0-ea0232dada22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1548c0ec16f04c4ea9f1538325fccfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:53Z,use_quota=True,user_id='0c6a9fe5a97c42a097bf542c3d308fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6e74cd-6beb-4fbc-a47a-f6c04f822adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6e74cd-6beb-4fbc-a47a-f6c04f822adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefc3eab-ddcc-4b20-987f-e29f0e81d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefc3eab-ddcc-4b20-987f-e29f0e81d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da15b810-f9d0-4262-b6d0-ea0232dada22', 'volume_name': 'volume-da15b810-f9d0-4262-b6d0-ea0232dada22', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17943ed-b048-4b3b-acba-d0f7837e4f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17943ed-b048-4b3b-acba-d0f7837e4f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5005bc-16cb-4232-b000-dff9b0af0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Volume da15b810-f9d0-4262-b6d0-ea0232dada22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da15b810-f9d0-4262-b6d0-ea0232dada22', 'volume_size': 1} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1114132908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da15b810-f9d0-4262-b6d0-ea0232dada22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1548c0ec16f04c4ea9f1538325fccfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:01:53Z,use_quota=True,user_id='0c6a9fe5a97c42a097bf542c3d308fba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Creating volume da15b810-f9d0-4262-b6d0-ea0232dada22 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:01:53 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:53 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 1073741824 Jul 22 02:01:53 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-2800a4ab-6333-4928-9f76-afb260a12168 req-cbace106-d2b0-4648-8439-03dffb0926f1 tempest-TestStampPattern-1844322949 None] Terminate volume connection completed successfully. Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-2800a4ab-6333-4928-9f76-afb260a12168 req-cbace106-d2b0-4648-8439-03dffb0926f1 tempest-TestStampPattern-1844322949 None] Deleting attachment 20eacbc9-d9ce-4ca9-971f-38ef41717bb2. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:01:53 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 1073741824" returned: 0 in 0.600s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:53 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 Jul 22 02:01:53 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:54 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22" returned: 0 in 0.445s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5005bc-16cb-4232-b000-dff9b0af0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da15b810-f9d0-4262-b6d0-ea0232dada22', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09b77b2-fe77-4636-bbd0-0064d1011dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Creating offline snapshot 74174111-4967-4db3-9a99-19aa8a56a18f of volume d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:01:54 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Volume volume-da15b810-f9d0-4262-b6d0-ea0232dada22 (da15b810-f9d0-4262-b6d0-ea0232dada22): created successfully Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09b77b2-fe77-4636-bbd0-0064d1011dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Flow 'volume_create_manager' (de291f1e-488d-47e3-af9d-5e04a8ecb214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0008be31-9415-4350-9e3a-75de1fc0e58c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7b44f6a4-283e-4895-8055-40d17130a2a2 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Created volume successfully. Jul 22 02:01:54 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:01:54 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:54 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.433s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:54 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f 1G Jul 22 02:01:54 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:55 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f 1G" returned: 0 in 0.539s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:55 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:01:55 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:55 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.496s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:55 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f is being set with open permissions: ugo+rw Jul 22 02:01:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:55 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:01:55 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:56 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:56 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info Jul 22 02:01:56 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:56 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info" returned: 0 in 0.428s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:56 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info is being set with open permissions: ugo+rw Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:56 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info Jul 22 02:01:56 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Acquiring lock "cinder-da15b810-f9d0-4262-b6d0-ea0232dada22-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "cinder-da15b810-f9d0-4262-b6d0-ea0232dada22-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Acquiring lock "cinder-quobyte-da15b810-f9d0-4262-b6d0-ea0232dada22" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "cinder-quobyte-da15b810-f9d0-4262-b6d0-ea0232dada22" acquired by "delete_volume" :: waited 0.044s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c28e0-de09-4418-b531-c8acdc3647fe]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:57 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.info" returned: 0 in 0.445s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-867d0418-661a-4f14-980a-4e013211066e tempest-TestStampPattern-1844322949 None] Create snapshot completed successfully Jul 22 02:01:57 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 Jul 22 02:01:57 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:57 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22" returned: 0 in 0.635s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:57 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22 Jul 22 02:01:57 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:58 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-da15b810-f9d0-4262-b6d0-ea0232dada22" returned: 0 in 0.432s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "cinder-quobyte-da15b810-f9d0-4262-b6d0-ea0232dada22" released by "delete_volume" :: held 1.149s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Created reservations ['0d7276f3-c028-4776-b7be-fa284ebec589', '99e36abd-aa24-48b2-878c-a72d97b3d1a4', 'e9946aae-c402-4f64-95e8-ca914cd730bc', '06f0f892-0d0a-41bf-abfd-15ad285a4854'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:01:58 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:01:58 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:01:58 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:01:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Deleted volume successfully. Jul 22 02:01:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eee8dbdc-a37e-4917-b1d4-661fd20f9b60 tempest-VolumeQuotasNegativeTestJSON-565663005 None] Lock "cinder-da15b810-f9d0-4262-b6d0-ea0232dada22-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Flow 'volume_create_manager' (f86e2aeb-a6d4-4fbc-ad1b-a8ffcfc65e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24984f50-c5c3-4836-b11b-4441b49046bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24984f50-c5c3-4836-b11b-4441b49046bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1373990220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f865081d-889b-4789-91da-a9dacd74fac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cce94e2e20da4757b83dd970154bf040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74174111-4967-4db3-9a99-19aa8a56a18f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:08Z,use_quota=True,user_id='98a9a19d19874b4baf50f4bde9c90fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509d16f-6c7e-40fb-b56e-c030d52f5979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6509d16f-6c7e-40fb-b56e-c030d52f5979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298ddc9-2b00-4e30-9165-eae7fcea8b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c298ddc9-2b00-4e30-9165-eae7fcea8b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f865081d-889b-4789-91da-a9dacd74fac5', 'volume_name': 'volume-f865081d-889b-4789-91da-a9dacd74fac5', 'volume_size': 1, 'snapshot_id': '74174111-4967-4db3-9a99-19aa8a56a18f'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d439508-2ab2-42ea-927b-4d5af2df9c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d439508-2ab2-42ea-927b-4d5af2df9c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14380ee7-db15-428c-8899-efae8e141bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:08 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Volume f865081d-889b-4789-91da-a9dacd74fac5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f865081d-889b-4789-91da-a9dacd74fac5', 'volume_size': 1, 'snapshot_id': '74174111-4967-4db3-9a99-19aa8a56a18f'} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f-f865081d-889b-4789-91da-a9dacd74fac5" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f-f865081d-889b-4789-91da-a9dacd74fac5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Creating volume f865081d-889b-4789-91da-a9dacd74fac5 from snapshot 74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] snapshot: 74174111-4967-4db3-9a99-19aa8a56a18f, volume: f865081d-889b-4789-91da-a9dacd74fac5, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[42648368-8bea-42a5-ab1d-34d739d6f541]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:08 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:02:08 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:09 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.493s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a566ce-d539-4c3c-837c-0220758bb6f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce8e76-70bd-4ed8-99d8-a68f3f0f6a40]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:09 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:02:09 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:09 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.517s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:02:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:09 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 Jul 22 02:02:09 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Flow 'volume_create_manager' (80c09a69-386b-4129-9e40-c7d41f7711bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79303722-aa0d-4049-978d-3faf8834ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79303722-aa0d-4049-978d-3faf8834ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372769528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d6bf0b-4117-408b-816e-37e0c6fa4b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15375eb0440445c827d1023871b9b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:16Z,use_quota=True,user_id='d139719f770046ccbae2fb74e4cd6584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9c900-59eb-4b1c-9d12-fd2bd264933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f9c900-59eb-4b1c-9d12-fd2bd264933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee42b48-fe87-447b-96d7-92e8626955e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee42b48-fe87-447b-96d7-92e8626955e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d6bf0b-4117-408b-816e-37e0c6fa4b68', 'volume_name': 'volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f697d915-3c09-4fe0-803e-d6bd7c3d2609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f697d915-3c09-4fe0-803e-d6bd7c3d2609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adaf8d3-8a96-4fb8-99ee-31b3541401f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68', 'volume_size': 1} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:16 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5" returned: 0 in 6.636s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37b645-0fa9-473c-acdb-cd6527fed88f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:16 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:02:16 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:17 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 1.080s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:17 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:02:17 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Converted 1024.00 MB image at 154.27 MB/s Jul 22 02:02:17 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 is being set with open permissions: ugo+rw Jul 22 02:02:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:17 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 Jul 22 02:02:17 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:18 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5" returned: 0 in 0.677s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" released by "_copy_volume_from_snapshot" :: held 9.590s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f-f865081d-889b-4789-91da-a9dacd74fac5" released by "_create_volume_from_snapshot" :: held 9.635s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.660s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372769528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d6bf0b-4117-408b-816e-37e0c6fa4b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d15375eb0440445c827d1023871b9b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:16Z,use_quota=True,user_id='d139719f770046ccbae2fb74e4cd6584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Creating volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:02:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:18 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 1073741824 Jul 22 02:02:18 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14380ee7-db15-428c-8899-efae8e141bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f865081d-889b-4789-91da-a9dacd74fac5', 'volume_size': 1, 'snapshot_id': '74174111-4967-4db3-9a99-19aa8a56a18f'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a20402-9485-44e6-9d6f-2ce8e99823ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Volume volume-f865081d-889b-4789-91da-a9dacd74fac5 (f865081d-889b-4789-91da-a9dacd74fac5): created successfully Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a20402-9485-44e6-9d6f-2ce8e99823ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Flow 'volume_create_manager' (f86e2aeb-a6d4-4fbc-ad1b-a8ffcfc65e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c7bca0c9-10c9-4ab6-b8e8-56afeb34daf0 tempest-TestStampPattern-1844322949 None] Created volume successfully. Jul 22 02:02:19 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 1073741824" returned: 0 in 1.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:19 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:02:19 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:20 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.611s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adaf8d3-8a96-4fb8-99ee-31b3541401f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e70125-7893-48ee-898f-ff8354cb1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Volume volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 (33d6bf0b-4117-408b-816e-37e0c6fa4b68): created successfully Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e70125-7893-48ee-898f-ff8354cb1e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Flow 'volume_create_manager' (80c09a69-386b-4129-9e40-c7d41f7711bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e2bf6b84-4190-4c84-ab6b-2faf98b6e14d tempest-VolumesActionsTest-1549476538 None] Created volume successfully. Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Flow 'volume_create_manager' (6e980a74-651a-4412-9f30-a74aad5fa477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e9ea3c-b20a-41d1-a819-142df5ee9daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e9ea3c-b20a-41d1-a819-142df5ee9daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-696584545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfcba49-8581-4c25-95a4-2d30d40d11dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8c2e840eef43c18bdf4eb532410cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:26Z,use_quota=True,user_id='4dabce670adc42f9bbf675877326ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882212d-267f-4ec5-b75c-e53fedc66f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882212d-267f-4ec5-b75c-e53fedc66f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4762b09e-896e-406b-a8c5-be267aa50ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4762b09e-896e-406b-a8c5-be267aa50ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfcba49-8581-4c25-95a4-2d30d40d11dc', 'volume_name': 'volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8514602b-cc11-4d76-979b-e1b71343779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8514602b-cc11-4d76-979b-e1b71343779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d22611-4605-43cf-8132-9e2b0c06adee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Volume 1cfcba49-8581-4c25-95a4-2d30d40d11dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc', 'volume_size': 1} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-696584545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfcba49-8581-4c25-95a4-2d30d40d11dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8c2e840eef43c18bdf4eb532410cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:26Z,use_quota=True,user_id='4dabce670adc42f9bbf675877326ccd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Creating volume 1cfcba49-8581-4c25-95a4-2d30d40d11dc {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:02:25 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:02:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:26 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc 1073741824 Jul 22 02:02:26 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:27 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc 1073741824" returned: 0 in 1.300s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:27 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc Jul 22 02:02:27 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Flow 'volume_create_manager' (0cdc0395-7b7b-4bdf-89a4-449d6d98f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3e553-2c70-4cb0-8d0b-6aea391c4033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d3e553-2c70-4cb0-8d0b-6aea391c4033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-203624548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a76932-e7eb-4bee-ad12-d20b0888e8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c41bb653a824aee8bbc2f347871e857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:27Z,use_quota=True,user_id='adad0ba3552147d2a2e04e4b443c1bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:27 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7867c0a-5418-4827-b3b6-1bc0b50b7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7867c0a-5418-4827-b3b6-1bc0b50b7771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262c38f-e546-4e0f-b8c2-ab3a0c6e8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262c38f-e546-4e0f-b8c2-ab3a0c6e8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a76932-e7eb-4bee-ad12-d20b0888e8d3', 'volume_name': 'volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8596e2e-22f3-4730-ae69-9aabba6e39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8596e2e-22f3-4730-ae69-9aabba6e39ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba791623-b5bf-478e-ba2a-3c52bcb092d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Volume 48a76932-e7eb-4bee-ad12-d20b0888e8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3', 'volume_size': 1} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc" returned: 0 in 0.639s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-203624548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a76932-e7eb-4bee-ad12-d20b0888e8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c41bb653a824aee8bbc2f347871e857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:27Z,use_quota=True,user_id='adad0ba3552147d2a2e04e4b443c1bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Creating volume 48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:02:28 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:28 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 1073741824 Jul 22 02:02:28 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d22611-4605-43cf-8132-9e2b0c06adee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23af48b-b724-4f48-83bf-be34d67994ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:28 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Volume volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc (1cfcba49-8581-4c25-95a4-2d30d40d11dc): created successfully Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23af48b-b724-4f48-83bf-be34d67994ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Flow 'volume_create_manager' (6e980a74-651a-4412-9f30-a74aad5fa477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d3d434fc-e5ab-4290-ad10-8d3ea4c6eb20 tempest-TestMinimumBasicScenario-1480769798 None] Created volume successfully. Jul 22 02:02:29 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 1073741824" returned: 0 in 1.608s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:29 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 Jul 22 02:02:29 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:30 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3" returned: 0 in 1.002s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] <== create_volume: return (2739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.746s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba791623-b5bf-478e-ba2a-3c52bcb092d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fb9555-74f0-4fa2-ae91-60ca0aa57ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Volume volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 (48a76932-e7eb-4bee-ad12-d20b0888e8d3): created successfully Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fb9555-74f0-4fa2-ae91-60ca0aa57ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Flow 'volume_create_manager' (0cdc0395-7b7b-4bdf-89a4-449d6d98f969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7e768f30-c42e-4574-af94-f9c3e538c93e tempest-SnapshotMetadataTestJSON-790139316 None] Created volume successfully. Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Creating offline snapshot 5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 of volume 48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ff4ed9-ddbf-4f8a-a045-91bc7c89036e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-bb3d6bc9-b6c2-4bb3-b92b-033dec4be617 req-34146f72-e3b9-4488-92b9-da9eaef348b6 tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:32 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 Jul 22 02:02:32 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:33 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3" returned: 0 in 0.742s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:33 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 1G Jul 22 02:02:33 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:33 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 1G" returned: 0 in 0.591s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:33 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 Jul 22 02:02:33 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:34 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:34 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 is being set with open permissions: ugo+rw Jul 22 02:02:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:34 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 Jul 22 02:02:34 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:34 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:34 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info Jul 22 02:02:34 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:35 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info" returned: 0 in 0.573s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:35 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info is being set with open permissions: ugo+rw Jul 22 02:02:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:35 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info Jul 22 02:02:35 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:35 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.info" returned: 0 in 0.685s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.646s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-bb3d6bc9-b6c2-4bb3-b92b-033dec4be617 req-34146f72-e3b9-4488-92b9-da9eaef348b6 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.510s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-bb3d6bc9-b6c2-4bb3-b92b-033dec4be617 req-34146f72-e3b9-4488-92b9-da9eaef348b6 tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.090s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b21dade4-7891-48a3-9ff8-e20d7d151320 tempest-SnapshotMetadataTestJSON-790139316 None] Create snapshot completed successfully Jul 22 02:02:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-bb3d6bc9-b6c2-4bb3-b92b-033dec4be617 req-34146f72-e3b9-4488-92b9-da9eaef348b6 tempest-TestMinimumBasicScenario-1480769798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c3a6ba2-82a3-4f04-8f7f-fc6abe5a3cd5', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:02:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-bb3d6bc9-b6c2-4bb3-b92b-033dec4be617 req-34146f72-e3b9-4488-92b9-da9eaef348b6 tempest-TestMinimumBasicScenario-1480769798 None] attachment_update completed successfully. Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "cinder-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "cinder-quobyte-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Deleting offline snapshot 5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 of volume 48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] snapshot_file for this snap is: volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdaa73c-a2e5-4279-9013-ce6eb563a6c4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:38 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 Jul 22 02:02:38 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ed26e4d6-e855-4864-9e6d-562da7d670c3 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" by "attach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ed26e4d6-e855-4864-9e6d-562da7d670c3 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" acquired by "attach_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ed26e4d6-e855-4864-9e6d-562da7d670c3 tempest-VolumesActionsTest-1549476538 None] Attaching volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68 to instance f814c49d-6ba9-4885-94d4-cacc37fd0b3d at mountpoint /dev/vdb on host None. Jul 22 02:02:39 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" returned: 0 in 1.091s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a402acb-9f80-413f-bc15-69f6eeff2e93]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ed26e4d6-e855-4864-9e6d-562da7d670c3 tempest-VolumesActionsTest-1549476538 None] Attach volume completed successfully. Jul 22 02:02:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ed26e4d6-e855-4864-9e6d-562da7d670c3 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" released by "attach_volume" :: held 0.270s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:39 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 Jul 22 02:02:39 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-594b43e7-0aab-4466-be27-2da4237b876f tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" by "detach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-594b43e7-0aab-4466-be27-2da4237b876f tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-594b43e7-0aab-4466-be27-2da4237b876f tempest-VolumesActionsTest-1549476538 None] Detaching volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68 from instance f814c49d-6ba9-4885-94d4-cacc37fd0b3d. Jul 22 02:02:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-594b43e7-0aab-4466-be27-2da4237b876f tempest-VolumesActionsTest-1549476538 None] Detach volume completed successfully. Jul 22 02:02:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-594b43e7-0aab-4466-be27-2da4237b876f tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:40 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3" returned: 0 in 0.723s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:40 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 Jul 22 02:02:40 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:41 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" returned: 0 in 0.822s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:41 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3 Jul 22 02:02:41 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:41 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3.5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3" released by "_delete_snapshot" :: held 3.422s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" released by "delete_snapshot" :: held 3.459s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:42 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Created reservations ['e44d9b53-9ba0-42b2-8002-1395e4c3adc7', '7f231072-f623-4e47-84ad-cf252bf9a62a', '1a1f7f90-efb4-4576-a39d-babf28206a4d', '87cab082-e5cc-4469-a0a1-36c3e1ee053a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:02:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Delete snapshot completed successfully. Jul 22 02:02:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6ea21cae-70b7-4541-8df9-8fd21146055d tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-5e289a0d-e9db-4096-a8eb-5bbfe0b13ec3-delete_snapshot" released by "delete_snapshot" :: held 3.795s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "cinder-48a76932-e7eb-4bee-ad12-d20b0888e8d3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-48a76932-e7eb-4bee-ad12-d20b0888e8d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f483b191-95f5-47d3-9ea6-385f8b402c78]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:43 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 Jul 22 02:02:43 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:43 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3" returned: 0 in 0.451s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:43 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3 Jul 22 02:02:43 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:44 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-48a76932-e7eb-4bee-ad12-d20b0888e8d3" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-quobyte-48a76932-e7eb-4bee-ad12-d20b0888e8d3" released by "delete_volume" :: held 0.804s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Created reservations ['e94bea81-f463-456f-9ec6-67f1ae9d6358', 'ff2bfb05-689e-4f30-b936-1f29bd2460d9', '334d032c-33f2-4236-8993-bcdaad8e4494', 'cfa4c077-0f03-4233-92a8-89fef1592ad5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:44 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:02:44 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:44 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.367s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:02:44 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Deleted volume successfully. Jul 22 02:02:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e019359d-181e-4d7d-b799-98ea797b5e91 tempest-SnapshotMetadataTestJSON-790139316 None] Lock "cinder-48a76932-e7eb-4bee-ad12-d20b0888e8d3-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:DELETE=7,cinder:SELECT=60,cinder:UPDATE=51,cinder:INSERT=12 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=58,cinder:UPDATE=55,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (ec187b8c-2188-471d-a74d-b32820428e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6be3cd-5c26-4247-b358-87dd6c5fa686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6be3cd-5c26-4247-b358-87dd6c5fa686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431703198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1332e34-f879-4e01-b45e-43ad2f4f6e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8592ea2dbe432eb428ce017819be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:48Z,use_quota=True,user_id='a71648d514b8454a8e7f853f281412cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1204328-e90c-42d3-9b57-fcd495c8ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1204328-e90c-42d3-9b57-fcd495c8ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6fce0-c052-4d1c-915c-9bc56e3472f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6fce0-c052-4d1c-915c-9bc56e3472f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1332e34-f879-4e01-b45e-43ad2f4f6e72', 'volume_name': 'volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3a9eed-093e-4e07-975b-7e072c5b0819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3a9eed-093e-4e07-975b-7e072c5b0819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abba516-0c9c-487b-9536-040e37e5c3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Volume c1332e34-f879-4e01-b45e-43ad2f4f6e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72', 'volume_size': 1} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431703198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1332e34-f879-4e01-b45e-43ad2f4f6e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8592ea2dbe432eb428ce017819be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:02:48Z,use_quota=True,user_id='a71648d514b8454a8e7f853f281412cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Creating volume c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:02:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:02:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:48 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 1073741824 Jul 22 02:02:48 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:49 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 1073741824" returned: 0 in 0.516s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:49 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 Jul 22 02:02:49 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:49 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72" returned: 0 in 0.359s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abba516-0c9c-487b-9536-040e37e5c3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bb7077-f70c-466d-9bc2-0cb7c4099717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:02:49 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Volume volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 (c1332e34-f879-4e01-b45e-43ad2f4f6e72): created successfully Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bb7077-f70c-466d-9bc2-0cb7c4099717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:02:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (ec187b8c-2188-471d-a74d-b32820428e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:02:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4571e5b2-739f-4894-85b4-ea46b8242dfd tempest-VolumesDeleteCascade-142840921 None] Created volume successfully. Jul 22 02:02:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Creating offline snapshot 920d387d-cb22-458b-b020-df5ff9870c0b of volume c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:02:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745f331-871f-4c9c-9534-d0892e67b1b0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:51 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 Jul 22 02:02:51 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:51 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72" returned: 0 in 0.735s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:51 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b 1G Jul 22 02:02:51 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:52 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b 1G" returned: 0 in 0.713s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:52 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:02:52 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:52 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:02:52 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:52 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 0.400s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:52 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b is being set with open permissions: ugo+rw Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:52 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:02:52 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:52 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.376s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:02:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:02:53 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 0.316s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:53 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info Jul 22 02:02:53 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:53 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:53 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info is being set with open permissions: ugo+rw Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:53 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info Jul 22 02:02:53 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:53 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.info" returned: 0 in 0.297s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.883s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bee57e45-178d-4930-8447-57d8b1216228 tempest-VolumesDeleteCascade-142840921 None] Create snapshot completed successfully Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-abec5bca-107a-4fc8-83e1-6edee9599989 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" by "attach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-abec5bca-107a-4fc8-83e1-6edee9599989 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" acquired by "attach_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-abec5bca-107a-4fc8-83e1-6edee9599989 tempest-VolumesActionsTest-1549476538 None] Attaching volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68 to instance 4bfe8e07-5902-492f-bafc-aa91844de127 at mountpoint /dev/vdb on host None. Jul 22 02:02:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-abec5bca-107a-4fc8-83e1-6edee9599989 tempest-VolumesActionsTest-1549476538 None] Attach volume completed successfully. Jul 22 02:02:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-abec5bca-107a-4fc8-83e1-6edee9599989 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68" released by "attach_volume" :: held 0.092s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11a5b6f6-c601-430d-905e-495d98569532 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" by "detach_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11a5b6f6-c601-430d-905e-495d98569532 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-11a5b6f6-c601-430d-905e-495d98569532 tempest-VolumesActionsTest-1549476538 None] Detaching volume 33d6bf0b-4117-408b-816e-37e0c6fa4b68 from instance 4bfe8e07-5902-492f-bafc-aa91844de127. Jul 22 02:02:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-11a5b6f6-c601-430d-905e-495d98569532 tempest-VolumesActionsTest-1549476538 None] Detach volume completed successfully. Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11a5b6f6-c601-430d-905e-495d98569532 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Creating offline snapshot 58d78a22-b830-4b7e-a650-b8864ec5b10f of volume c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b3cdca-cbda-44e9-b274-d74457e4044c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:54 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:02:54 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:54 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 0.470s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:02:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:54 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f 1G Jul 22 02:02:54 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:55 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f 1G" returned: 0 in 0.593s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:55 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f Jul 22 02:02:55 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:55 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f" returned: 0 in 0.437s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:55 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f is being set with open permissions: ugo+rw Jul 22 02:02:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:55 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f Jul 22 02:02:55 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:56 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f" returned: 0 in 0.463s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:02:56 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b2999fb8-6bdc-4e96-963a-4316e6b56c8e tempest-VolumesDeleteCascade-142840921 None] Create snapshot completed successfully Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-c1332e34-f879-4e01-b45e-43ad2f4f6e72-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-c1332e34-f879-4e01-b45e-43ad2f4f6e72-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Performing cascade delete. {{(pid=87153) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-58d78a22-b830-4b7e-a650-b8864ec5b10f-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-58d78a22-b830-4b7e-a650-b8864ec5b10f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-58d78a22-b830-4b7e-a650-b8864ec5b10f" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-58d78a22-b830-4b7e-a650-b8864ec5b10f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Deleting offline snapshot 58d78a22-b830-4b7e-a650-b8864ec5b10f of volume c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] snapshot_file for this snap is: volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c214a9-c087-447b-9969-de87b569a24e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:57 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f Jul 22 02:02:57 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:58 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f" returned: 0 in 0.492s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c811ca8-0e56-45bf-8432-674b54763919]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:58 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:02:58 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:58 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:02:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:58 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f Jul 22 02:02:58 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:59 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f" returned: 0 in 0.509s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:02:59 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f Jul 22 02:02:59 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[64339c55-dbeb-403b-9912-fad5db6c322c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:59 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:02:59 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:02:59 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.58d78a22-b830-4b7e-a650-b8864ec5b10f" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-58d78a22-b830-4b7e-a650-b8864ec5b10f" released by "_delete_snapshot" :: held 1.953s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" released by "delete_snapshot" :: held 1.985s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Created reservations ['1dbceb81-216d-4472-87e2-4a31e9b22b94', 'c8c9a7cd-d0dc-41d5-94a0-f7a45c25d8b7', 'a225e4c1-c82e-430c-9f14-7bf75bd04eec', '8b34b230-1a28-48f4-ab69-66037e01539f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:02:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Delete snapshot completed successfully. Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-58d78a22-b830-4b7e-a650-b8864ec5b10f-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-920d387d-cb22-458b-b020-df5ff9870c0b-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-920d387d-cb22-458b-b020-df5ff9870c0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:59 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.563s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-920d387d-cb22-458b-b020-df5ff9870c0b" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f11e691-33bd-4950-a93b-cc430010e125]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-920d387d-cb22-458b-b020-df5ff9870c0b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Deleting offline snapshot 920d387d-cb22-458b-b020-df5ff9870c0b of volume c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] snapshot_file for this snap is: volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a46e1f-e091-4605-ae94-b3967b40eac6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:02:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:00 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:00 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:00 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:03:00 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:00 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.4599b55f-1e9c-4153-805c-828cffcd7bedkyap045t.img {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:00 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.4599b55f-1e9c-4153-805c-828cffcd7bedkyap045t.img Jul 22 02:03:00 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:00 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 0.408s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f719e3-aa84-42d5-a343-e82a388e0ceb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:00 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 Jul 22 02:03:00 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:01 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72" returned: 0 in 0.807s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:01 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:03:01 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:02 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 1.199s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:02 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b Jul 22 02:03:02 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:03 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72.920d387d-cb22-458b-b020-df5ff9870c0b" returned: 0 in 1.022s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-920d387d-cb22-458b-b020-df5ff9870c0b" released by "_delete_snapshot" :: held 3.616s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" released by "delete_snapshot" :: held 3.673s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:03 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Created reservations ['2bbf4bc3-d2f8-43f0-b57b-dacbeb048f48', '89ba264e-1855-4c9c-8ccf-ef7bab306f4a', 'cb8e0682-2900-4db3-9ce9-fd893b31e499', '06597760-6f3a-4d86-a7e3-f5f397336b7a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Delete snapshot completed successfully. Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-920d387d-cb22-458b-b020-df5ff9870c0b-delete_snapshot" released by "delete_snapshot" :: held 4.138s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Snapshots deleted, issuing volume delete {{(pid=87153) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" acquired by "delete_volume" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7afce0-d82d-4387-b508-78e945cbd777]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:04 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 Jul 22 02:03:04 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:05 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72" returned: 0 in 1.048s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:05 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72 Jul 22 02:03:05 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:05 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c1332e34-f879-4e01-b45e-43ad2f4f6e72" returned: 0 in 0.651s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-c1332e34-f879-4e01-b45e-43ad2f4f6e72" released by "delete_volume" :: held 1.914s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Created reservations ['dce5c5c6-37ff-4e38-ad0a-aa543fbfe2e5', 'ec29d842-e160-4292-9712-ddbcb52165e4', '1cd88f9a-9c0d-4baf-b9a9-73012165af3e', '0f58766f-7481-4948-9177-16dc6fca378a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:06 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.4599b55f-1e9c-4153-805c-828cffcd7bedkyap045t.img" returned: 0 in 5.850s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff1d30-b1b3-42df-a13c-713784742197]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:06 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:06 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:06 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:06 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:06 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.260s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Deleted volume successfully. Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfaa896d-1b36-4bbe-aecd-a76b8f3c631c tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-c1332e34-f879-4e01-b45e-43ad2f4f6e72-delete_volume" released by "delete_volume" :: held 8.971s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:06 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.555s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.4599b55f-1e9c-4153-805c-828cffcd7bedkyap045t.img {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:03:06 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Converted 1024.00 MB image at 175.01 MB/s Jul 22 02:03:06 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] 4599b55f-1e9c-4153-805c-828cffcd7bed was raw, no need to convert to raw {{(pid=87153) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (4af15cd8-139d-4feb-b87b-570984cc75c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390bc956-e096-432b-b2a6-486ea4d00cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390bc956-e096-432b-b2a6-486ea4d00cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2081907175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8592ea2dbe432eb428ce017819be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:03:08Z,use_quota=True,user_id='a71648d514b8454a8e7f853f281412cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534a6f0-3b6d-44fd-80b9-9fad0880d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534a6f0-3b6d-44fd-80b9-9fad0880d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726e22fc-8f65-49e5-b804-2f3fddc7e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726e22fc-8f65-49e5-b804-2f3fddc7e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f', 'volume_name': 'volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd84da67-bc38-4af6-8108-6367d3918b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd84da67-bc38-4af6-8108-6367d3918b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b8d8c-2a4c-47d9-86c7-bf35a9e459da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Volume 6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f', 'volume_size': 1} Jul 22 02:03:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:24 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=34,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:03:24 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:INSERT=7,cinder:UPDATE=26,cinder:SELECT=33,cinder:DELETE=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.142s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Uploaded volume to glance image-id: 4599b55f-1e9c-4153-805c-828cffcd7bed. {{(pid=87153) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.751s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2081907175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8592ea2dbe432eb428ce017819be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:03:08Z,use_quota=True,user_id='a71648d514b8454a8e7f853f281412cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Creating volume 6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:03:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:26 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f 1073741824 Jul 22 02:03:26 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7e8cb1e6-e72a-442a-a15a-ee47a8ad836d tempest-VolumesActionsTest-1549476538 None] Copy volume to image completed successfully. Jul 22 02:03:26 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f 1073741824" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:26 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:26 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:27 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.587s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b8d8c-2a4c-47d9-86c7-bf35a9e459da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7048354-ef81-4fb4-b80a-e5a967cd8764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Volume volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f (6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f): created successfully Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7048354-ef81-4fb4-b80a-e5a967cd8764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (4af15cd8-139d-4feb-b87b-570984cc75c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf3dc13-a645-4f03-bfbb-0aa990cff0ca]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2bc99502-3bd9-4e33-93f7-530b5f7a3022 tempest-VolumesDeleteCascade-142840921 None] Created volume successfully. Jul 22 02:03:27 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 Jul 22 02:03:27 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:27 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.448s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.209s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6e5c1a-604d-413c-bf39-89b68383dc96]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-f865081d-889b-4789-91da-a9dacd74fac5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ec8980d-37db-490c-9dfe-aa99ad6ee3d4', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:03:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3aa2fb00-971a-42ea-bd1f-d70888080a6e req-ecb13fc5-b5d2-4633-a2e5-9b66c688bb6a tempest-TestStampPattern-1844322949 None] attachment_update completed successfully. Jul 22 02:03:27 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:27 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:28 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.413s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c705754-aaff-43cc-9e0b-ce47f0c134ec]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:28 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:28 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:28 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:28 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img Jul 22 02:03:28 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-08101300-490a-40ca-bf0f-9cb5ae14ebf4 req-2d6e4a37-d157-47b3-9559-1e3cd90b6e23 tempest-TestStampPattern-1844322949 None] Terminate volume connection completed successfully. Jul 22 02:03:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-08101300-490a-40ca-bf0f-9cb5ae14ebf4 req-2d6e4a37-d157-47b3-9559-1e3cd90b6e23 tempest-TestStampPattern-1844322949 None] Deleting attachment 9ec8980d-37db-490c-9dfe-aa99ad6ee3d4. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:03:33 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img" returned: 0 in 4.912s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cf1263-48fa-4a74-9e74-101cdd797f65]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:33 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:33 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:34 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.768s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:03:34 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Converted 1024.00 MB image at 208.44 MB/s Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] 9444036c-afba-40ea-8295-cef9e2dbb115 was raw, converting to qcow2 {{(pid=87153) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a2143-f6d1-4d26-9db1-a489fce039ba]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:34 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img Jul 22 02:03:34 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:34 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img" returned: 0 in 0.332s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:34 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img Jul 22 02:03:34 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:34 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img" returned: 1 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:03:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img /opt/stack/data/cinder/conversion/vol_upload_z2_soyln {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:35 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img /opt/stack/data/cinder/conversion/vol_upload_z2_soyln Jul 22 02:03:35 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:35 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img /opt/stack/data/cinder/conversion/vol_upload_z2_soyln" returned: 0 in 0.339s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:35 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Image conversion details: src /opt/stack/data/cinder/conversion/33d6bf0b-4117-408b-816e-37e0c6fa4b68.temp_image.9444036c-afba-40ea-8295-cef9e2dbb115yply1kwd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z2_soyln {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:03:35 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 22 02:03:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfaa9aa-f2f6-49c1-87ae-3f2616c451f9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z2_soyln {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:35 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z2_soyln Jul 22 02:03:35 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:35 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z2_soyln" returned: 0 in 0.339s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-f865081d-889b-4789-91da-a9dacd74fac5-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "cinder-f865081d-889b-4789-91da-a9dacd74fac5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a3e45-341c-475d-8bcb-7449c314242c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:36 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 Jul 22 02:03:36 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:36 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:36 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5 Jul 22 02:03:36 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:36 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f865081d-889b-4789-91da-a9dacd74fac5" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-f865081d-889b-4789-91da-a9dacd74fac5" released by "delete_volume" :: held 0.695s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Created reservations ['c4031dee-2172-4d7e-937b-967232087e33', 'c4bad456-0bf0-49c0-bbc9-298371a91a9c', '9e7c0b23-58c6-48d2-82f9-cb6d888e57ac', '799a3711-0848-438c-828c-705b3fd4bb83'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:36 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:36 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.360s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Uploaded volume to glance image-id: 9444036c-afba-40ea-8295-cef9e2dbb115. {{(pid=87153) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.258s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Creating offline snapshot 92ad84e3-2573-432e-ad3f-7f89141584d3 of volume 6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:03:37 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b6036ad3-e0a7-4f6e-8c02-7848b36f7537 tempest-VolumesActionsTest-1549476538 None] Copy volume to image completed successfully. Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e45e5-67d1-4fd0-8a9a-f198bbe673f4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:37 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:37 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:37 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:37 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Deleted volume successfully. Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f32ea500-65db-4598-b417-53662708fc9d tempest-TestStampPattern-1844322949 None] Lock "cinder-f865081d-889b-4789-91da-a9dacd74fac5-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:37 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-74174111-4967-4db3-9a99-19aa8a56a18f-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.429s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-74174111-4967-4db3-9a99-19aa8a56a18f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:37 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 1G Jul 22 02:03:37 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Deleting offline snapshot 74174111-4967-4db3-9a99-19aa8a56a18f of volume d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] snapshot_file for this snap is: volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4cb0ea-8b02-4438-aeef-cdcd92c177ed]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:37 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:03:37 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:38 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 1G" returned: 0 in 0.513s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:38 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:38 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:38 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.493s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7a566ce-d539-4c3c-837c-0220758bb6f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9a0e5-6cce-4174-b766-1dd13fccab9b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:38 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:03:38 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:38 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:38 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 is being set with open permissions: ugo+rw Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:38 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:38 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:38 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:38 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:03:38 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:38 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:39 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info Jul 22 02:03:39 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "cinder-quobyte-33d6bf0b-4117-408b-816e-37e0c6fa4b68" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-quobyte-33d6bf0b-4117-408b-816e-37e0c6fa4b68" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d52b0-c479-441e-9fe4-90ae24d2bb04]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:39 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.598s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:39 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:39 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:39 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info is being set with open permissions: ugo+rw Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:39 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f Jul 22 02:03:39 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:39 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info Jul 22 02:03:39 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:39 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8.74174111-4967-4db3-9a99-19aa8a56a18f" returned: 0 in 0.311s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.544s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-74174111-4967-4db3-9a99-19aa8a56a18f" released by "_delete_snapshot" :: held 2.075s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" released by "delete_snapshot" :: held 2.109s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:39 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68 Jul 22 02:03:39 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:39 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.info" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3eedd3f7-6f71-4dbb-9df9-ee07fc71069a tempest-VolumesDeleteCascade-142840921 None] Create snapshot completed successfully Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Created reservations ['991b8899-2040-4486-b403-7eed7c96931b', 'aa058a3b-e171-4336-897c-913c4a67bd3b', '7b32c60b-eb55-4bdc-b64e-b0173516e936', '749d1896-c068-446d-a333-e3385d6c0e47'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Delete snapshot completed successfully. Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-383aa2e0-1aca-43c6-b086-48716c850546 tempest-TestStampPattern-1844322949 None] Lock "cinder-74174111-4967-4db3-9a99-19aa8a56a18f-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:39 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33d6bf0b-4117-408b-816e-37e0c6fa4b68" returned: 0 in 0.301s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-quobyte-33d6bf0b-4117-408b-816e-37e0c6fa4b68" released by "delete_volume" :: held 0.892s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Created reservations ['4ac3d8a0-11f8-4c29-9cd6-3f52e3ccbc5d', '04169d93-2fe1-4cda-be83-fec3f2c9dcdf', '1a9d021d-2569-4016-b365-4bd00e5fead1', '52f7dc95-d76c-42b1-8890-00af70f822a0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:40 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:40 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:40 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Deleted volume successfully. Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69ee0bca-80a0-4a7c-861c-f826ed12a723 tempest-VolumesActionsTest-1549476538 None] Lock "cinder-33d6bf0b-4117-408b-816e-37e0c6fa4b68-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-9ce3d578-4122-404c-91ab-ce98c4e77805 req-49aea11b-f6b5-42aa-9fae-b44a21bb81a5 tempest-TestMinimumBasicScenario-1480769798 None] Terminate volume connection completed successfully. Jul 22 02:03:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-9ce3d578-4122-404c-91ab-ce98c4e77805 req-49aea11b-f6b5-42aa-9fae-b44a21bb81a5 tempest-TestMinimumBasicScenario-1480769798 None] Deleting attachment 0c3a6ba2-82a3-4f04-8f7f-fc6abe5a3cd5. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (c1c4d063-f35e-4fd5-9df6-ed32eede7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2705a-84fd-4e16-a05e-f661056b4a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2705a-84fd-4e16-a05e-f661056b4a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-239377496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfaacec-2d3e-4256-8d12-6a383e0c76de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8592ea2dbe432eb428ce017819be13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92ad84e3-2573-432e-ad3f-7f89141584d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:03:41Z,use_quota=True,user_id='a71648d514b8454a8e7f853f281412cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd78a2ef-c067-4ac5-a81b-c61cf45ed3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd78a2ef-c067-4ac5-a81b-c61cf45ed3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b895e24-d6a7-45f2-80fd-284e9b64baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b895e24-d6a7-45f2-80fd-284e9b64baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5dfaacec-2d3e-4256-8d12-6a383e0c76de', 'volume_name': 'volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de', 'volume_size': 1, 'snapshot_id': '92ad84e3-2573-432e-ad3f-7f89141584d3'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcfb008-4aa8-4bef-b44a-d5131b26277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcfb008-4aa8-4bef-b44a-d5131b26277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e58c6ae-00c4-4c6e-9870-c03718099d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:41 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Volume 5dfaacec-2d3e-4256-8d12-6a383e0c76de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de', 'volume_size': 1, 'snapshot_id': '92ad84e3-2573-432e-ad3f-7f89141584d3'} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3-5dfaacec-2d3e-4256-8d12-6a383e0c76de" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3-5dfaacec-2d3e-4256-8d12-6a383e0c76de" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Creating volume 5dfaacec-2d3e-4256-8d12-6a383e0c76de from snapshot 92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] snapshot: 92ad84e3-2573-432e-ad3f-7f89141584d3, volume: 5dfaacec-2d3e-4256-8d12-6a383e0c76de, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a819d8-c3e6-46c8-ac68-fca7ee20cd4f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:41 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:41 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "cinder-1cfcba49-8581-4c25-95a4-2d30d40d11dc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "cinder-1cfcba49-8581-4c25-95a4-2d30d40d11dc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:41 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "cinder-quobyte-1cfcba49-8581-4c25-95a4-2d30d40d11dc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.450s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "cinder-quobyte-1cfcba49-8581-4c25-95a4-2d30d40d11dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cca587-b07f-4638-9b2c-97cfab656398]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6776ea0a-4fcb-4ac7-bba0-65bda075ac8d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:42 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc Jul 22 02:03:42 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:42 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:42 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:42 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc" returned: 0 in 0.473s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:42 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc Jul 22 02:03:42 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:42 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.598s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:42 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de Jul 22 02:03:42 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:42 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cfcba49-8581-4c25-95a4-2d30d40d11dc" returned: 0 in 0.335s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "cinder-quobyte-1cfcba49-8581-4c25-95a4-2d30d40d11dc" released by "delete_volume" :: held 0.881s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:42 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Created reservations ['dcb3ec79-ec9b-439a-a0cc-16544dea2c39', '42b2a248-c588-41be-8394-0e6d69d227fe', 'e1939fb4-1c70-46ab-a7c2-182f4ecd6a32', 'cc0d7ae4-536c-4ecc-9a33-d3fb3a300613'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:43 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:43 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:43 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.845s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:43 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Deleted volume successfully. Jul 22 02:03:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a36137c-4b9d-485e-aaa0-90fbca26d3ad tempest-TestMinimumBasicScenario-1480769798 None] Lock "cinder-1cfcba49-8581-4c25-95a4-2d30d40d11dc-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:49 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de" returned: 0 in 6.966s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955f193-58a9-43fc-9294-3de05fabe0d9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:49 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:49 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-d7a566ce-d539-4c3c-837c-0220758bb6f8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "cinder-d7a566ce-d539-4c3c-837c-0220758bb6f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Acquiring lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:50 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.696s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:03:50 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Converted 1024.00 MB image at 146.98 MB/s Jul 22 02:03:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de is being set with open permissions: ugo+rw Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ef137-1720-4791-8a53-87a4ee537de9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:50 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de Jul 22 02:03:50 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:50 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:03:50 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:50 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" released by "_copy_volume_from_snapshot" :: held 9.157s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3-5dfaacec-2d3e-4256-8d12-6a383e0c76de" released by "_create_volume_from_snapshot" :: held 9.198s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.219s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e58c6ae-00c4-4c6e-9870-c03718099d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de', 'volume_size': 1, 'snapshot_id': '92ad84e3-2573-432e-ad3f-7f89141584d3'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6693ad46-82e6-4d77-b741-0cddbfb9df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Volume volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de (5dfaacec-2d3e-4256-8d12-6a383e0c76de): created successfully Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6693ad46-82e6-4d77-b741-0cddbfb9df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Flow 'volume_create_manager' (c1c4d063-f35e-4fd5-9df6-ed32eede7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:50 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6485aacf-c1ca-475c-9c66-1cf04c67145b tempest-VolumesDeleteCascade-142840921 None] Created volume successfully. Jul 22 02:03:50 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:50 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8 Jul 22 02:03:50 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:51 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d7a566ce-d539-4c3c-837c-0220758bb6f8" returned: 0 in 0.285s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "cinder-quobyte-d7a566ce-d539-4c3c-837c-0220758bb6f8" released by "delete_volume" :: held 0.914s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Created reservations ['772641bc-f97f-400a-807f-3b01851f703b', 'eb18b838-c324-403d-a1a7-321e32b0aec3', '1018f3d1-5f09-4ecd-9ef7-9c5c9fc3abd6', 'df940a5d-43c6-4085-822e-ae6baa1b42f0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:51 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:51 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:51 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.499s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Performing cascade delete. {{(pid=87153) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 22 02:03:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Deleted volume successfully. Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-92ad84e3-2573-432e-ad3f-7f89141584d3-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-075767c2-5054-463f-9be4-b8754527db84 tempest-TestStampPattern-1844322949 None] Lock "cinder-d7a566ce-d539-4c3c-837c-0220758bb6f8-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-92ad84e3-2573-432e-ad3f-7f89141584d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Deleting offline snapshot 92ad84e3-2573-432e-ad3f-7f89141584d3 of volume 6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] snapshot_file for this snap is: volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb8a949-9d3c-4252-9504-de860795b3e0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:52 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:52 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:52 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.499s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:03:52 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:52 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc08bf7-d5c4-4f37-8448-198d97cf85fc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:52 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:52 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:52 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.331s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:03:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:03:53 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.475s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:53 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:53 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:53 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:53 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3 Jul 22 02:03:53 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:53 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f.92ad84e3-2573-432e-ad3f-7f89141584d3" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-92ad84e3-2573-432e-ad3f-7f89141584d3" released by "_delete_snapshot" :: held 1.814s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" released by "delete_snapshot" :: held 1.836s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Created reservations ['b5703ff8-9c8f-4ad4-af46-0299eefdfa13', '6d851743-b415-4868-a449-a4df05e1088c', '2c8f12fd-1b10-42b3-9d86-0a2b218d4983', '24e1b655-ea26-4318-ae42-99c161e23af5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Delete snapshot completed successfully. Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-92ad84e3-2573-432e-ad3f-7f89141584d3-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Snapshots deleted, issuing volume delete {{(pid=87153) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f08a2d-1604-48eb-80b8-8e328bc84c62]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:54 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:54 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:54 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.445s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:54 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f Jul 22 02:03:54 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:54 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" returned: 0 in 0.333s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f" released by "delete_volume" :: held 0.911s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Created reservations ['11aaf099-e8e6-497f-b007-59844e85402b', 'b52793ef-a8b4-444f-b7b3-f9ee94d3f087', 'dda7aec0-5f28-41ed-8461-6a22d68b27d6', '692d04b6-8bff-4a54-abd0-a7e13ab517dd'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:55 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:55 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:55 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.370s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Deleted volume successfully. Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-949d7291-2215-4a58-bd14-8edd36fa2ac2 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-6cfcbec8-8e1e-4f36-84d2-e4aacf809e8f-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-5dfaacec-2d3e-4256-8d12-6a383e0c76de-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-5dfaacec-2d3e-4256-8d12-6a383e0c76de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3f45a-dff5-4b71-9cb6-d0ac9ab92fe3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:55 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de Jul 22 02:03:55 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:55 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:56 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de Jul 22 02:03:56 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:56 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5dfaacec-2d3e-4256-8d12-6a383e0c76de" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-quobyte-5dfaacec-2d3e-4256-8d12-6a383e0c76de" released by "delete_volume" :: held 0.900s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Created reservations ['157d3e17-3a20-4c1d-b1ad-56b9e95dbd61', '7056bdad-7d96-496a-a158-3d0aeb086577', '91c23d82-5e10-4c20-bc15-5bd917e2d11e', '0371f3c0-9a74-4efd-9358-f6de7b8ef109'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:56 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:03:56 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:56 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.304s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:03:56 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Deleted volume successfully. Jul 22 02:03:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f10538e7-65f3-4278-9a82-d537b3d44b09 tempest-VolumesDeleteCascade-142840921 None] Lock "cinder-5dfaacec-2d3e-4256-8d12-6a383e0c76de-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Flow 'volume_create_manager' (eccd9744-22a3-4a5a-96d5-a68dc7285536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a784b1f-4ee2-4e2c-8e72-541955d39990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a784b1f-4ee2-4e2c-8e72-541955d39990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-874056975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f5198e-01ab-46fc-9ec3-abcd51d8ecfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1479e9b96c83477d9be90ac676eb021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:03:58Z,use_quota=True,user_id='4b01d6970dbe489681a36c3efefefa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7c33b9-6d2b-489e-b73a-77e1a7dc1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7c33b9-6d2b-489e-b73a-77e1a7dc1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501d91b4-909f-4d1d-bec2-62b52eeb0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (501d91b4-909f-4d1d-bec2-62b52eeb0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f5198e-01ab-46fc-9ec3-abcd51d8ecfa', 'volume_name': 'volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7627ce7-e145-4833-91da-968098187f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7627ce7-e145-4833-91da-968098187f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6a88a-b26b-4580-a4fe-35458ee6fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa', 'volume_size': 1} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-874056975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f5198e-01ab-46fc-9ec3-abcd51d8ecfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1479e9b96c83477d9be90ac676eb021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:03:58Z,use_quota=True,user_id='4b01d6970dbe489681a36c3efefefa5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Creating volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:03:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:03:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:58 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa 1073741824 Jul 22 02:03:58 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:58 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa 1073741824" returned: 0 in 0.518s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:03:58 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa Jul 22 02:03:58 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:03:58 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad6a88a-b26b-4580-a4fe-35458ee6fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab8fc57-f9da-4b2b-abe9-b7a35616dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:03:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Volume volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa (19f5198e-01ab-46fc-9ec3-abcd51d8ecfa): created successfully Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab8fc57-f9da-4b2b-abe9-b7a35616dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:03:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Flow 'volume_create_manager' (eccd9744-22a3-4a5a-96d5-a68dc7285536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:03:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1dfff045-32aa-4c69-be9e-6c6f6621ff1b tempest-VolumesSnapshotListTestJSON-843623552 None] Created volume successfully. Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Creating offline snapshot a98403f2-4338-4f05-a31d-e1d3d0b4c2ca of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3830835d-60a8-45f0-b8c9-959d97524547]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:00 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa Jul 22 02:04:00 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:00 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" returned: 0 in 0.596s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:00 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca 1G Jul 22 02:04:00 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:01 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca 1G" returned: 0 in 0.589s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:01 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:01 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:01 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.438s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:01 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca is being set with open permissions: ugo+rw Jul 22 02:04:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:01 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:01 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:02 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.364s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:02 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info Jul 22 02:04:02 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:02 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info" returned: 0 in 0.316s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:02 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info is being set with open permissions: ugo+rw Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:02 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info Jul 22 02:04:02 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Flow 'volume_create_manager' (99ea316b-e15c-4162-bc5f-6d1f2445eb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f65d5b-81bd-4bc8-8d91-c003bddcfbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f65d5b-81bd-4bc8-8d91-c003bddcfbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1327254354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f669c18-eb05-4d78-a0ca-8544c1a75060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931bfff2801749a6b371de1e765d15ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:03Z,use_quota=True,user_id='a30cc8f8a9a7479cb9c21caabcef1271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcdc9f3-906a-4e20-9eb4-4065146170bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcdc9f3-906a-4e20-9eb4-4065146170bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c358f50-be7b-4072-8767-24d28b4bfef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:04:02 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.info" returned: 0 in 0.361s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e539978f-41cf-4621-80e6-2205bceaa8fa tempest-VolumesSnapshotListTestJSON-843623552 None] Create snapshot completed successfully Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c358f50-be7b-4072-8767-24d28b4bfef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f669c18-eb05-4d78-a0ca-8544c1a75060', 'volume_name': 'volume-2f669c18-eb05-4d78-a0ca-8544c1a75060', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209ef98-05c6-4d00-936f-646602beb12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2209ef98-05c6-4d00-936f-646602beb12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce76cc3-161d-4027-9545-0b7fba2c69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:03 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Volume 2f669c18-eb05-4d78-a0ca-8544c1a75060: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f669c18-eb05-4d78-a0ca-8544c1a75060', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Trying to clone 2f669c18-eb05-4d78-a0ca-8544c1a75060 from image 24473c99-a605-4f38-8ab8-40745fe15ef5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Creating offline snapshot 55023502-728c-4b45-a9c5-c3567a0d5efd of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3293b9e-2881-4504-a24b-5c3b55bb38ea]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:04:03 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Image download 20.69 MB at 20.69 MB/s Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd07193-6416-454a-ac77-891cbbc704bc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:03 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:03 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:04 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD Jul 22 02:04:04 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:04 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.473s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:04 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd 1G Jul 22 02:04:04 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:04 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 is fetched for user a30cc8f8a9a7479cb9c21caabcef1271. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a6112-27e4-4a6c-8f62-1805f4e7df5e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:04 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD Jul 22 02:04:04 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:04 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd 1G" returned: 0 in 0.514s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:04 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:04 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:04 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:05 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.382s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:05 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd is being set with open permissions: ugo+rw Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:05 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:05 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:05 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1327254354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f669c18-eb05-4d78-a0ca-8544c1a75060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931bfff2801749a6b371de1e765d15ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:03Z,use_quota=True,user_id='a30cc8f8a9a7479cb9c21caabcef1271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Creating volume 2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:05 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:05 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1073741824 Jul 22 02:04:05 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2af06068-2614-4342-bae8-1ea22c50916a tempest-VolumesSnapshotListTestJSON-843623552 None] Create snapshot completed successfully Jul 22 02:04:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:06 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1073741824" returned: 0 in 0.597s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:06 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 Jul 22 02:04:06 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:06 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060" returned: 0 in 0.359s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.578s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Creating offline snapshot 87d348f6-2aef-4c31-991a-d2de7c754af3 of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931ba71-d3ce-40f6-a368-c0508d5fd609]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Attempting download of 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 2f669c18-eb05-4d78-a0ca-8544c1a75060. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b67d7-3885-433a-a63b-9bdc879d3321]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:06 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:06 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:06 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw Jul 22 02:04:06 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:07 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.450s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:07 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:07 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 1G Jul 22 02:04:07 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:07 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw Jul 22 02:04:07 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:07 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw" returned: 1 in 0.412s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_j48qm4nw' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcff5439-a47d-48ad-94d9-8981145744df]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (43c8cca9-d65b-4cc4-83e2-5731fd113416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8be2c5e-0076-48ac-ab06-3b1e582f726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8be2c5e-0076-48ac-ab06-3b1e582f726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424380150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e820b0-b662-4614-b19a-6b18f0ded949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:08Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:07 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD Jul 22 02:04:07 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05de6f11-4280-413b-b4ee-15cc1926d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05de6f11-4280-413b-b4ee-15cc1926d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41b220d-bb02-4e4c-9d20-dfad6aa32300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41b220d-bb02-4e4c-9d20-dfad6aa32300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e820b0-b662-4614-b19a-6b18f0ded949', 'volume_name': 'volume-23e820b0-b662-4614-b19a-6b18f0ded949', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f345c74-1c11-41dc-a616-c9ec9203a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f345c74-1c11-41dc-a616-c9ec9203a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9113a41-e28b-47b9-9817-b19140c344b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume 23e820b0-b662-4614-b19a-6b18f0ded949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e820b0-b662-4614-b19a-6b18f0ded949', 'volume_size': 1} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:07 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 1G" returned: 0 in 0.685s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:07 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 Jul 22 02:04:07 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:07 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] 24473c99-a605-4f38-8ab8-40745fe15ef5 was qcow2, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:04:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:07 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 Jul 22 02:04:07 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:08 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3" returned: 0 in 0.364s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:08 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 is being set with open permissions: ugo+rw Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:08 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 Jul 22 02:04:08 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:08 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424380150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e820b0-b662-4614-b19a-6b18f0ded949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:08Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume 23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:08 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:08 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 1073741824 Jul 22 02:04:08 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2ea5e613-7417-4f05-9624-8145de4e3600 tempest-VolumesSnapshotListTestJSON-843623552 None] Create snapshot completed successfully Jul 22 02:04:08 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 1073741824" returned: 0 in 0.545s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:09 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 Jul 22 02:04:09 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:09 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949" returned: 0 in 0.365s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9113a41-e28b-47b9-9817-b19140c344b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e820b0-b662-4614-b19a-6b18f0ded949', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143133ea-350e-4c1c-b56c-cd124e488013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:09 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-23e820b0-b662-4614-b19a-6b18f0ded949 (23e820b0-b662-4614-b19a-6b18f0ded949): created successfully Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143133ea-350e-4c1c-b56c-cd124e488013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (43c8cca9-d65b-4cc4-83e2-5731fd113416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8a0e602c-de2f-4d06-9578-6ae938eaf25f tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-87d348f6-2aef-4c31-991a-d2de7c754af3-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:10 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060" returned: 0 in 2.171s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_o_brgqrtdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:04:10 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Converted 112.00 MB image at 51.55 MB/s Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-87d348f6-2aef-4c31-991a-d2de7c754af3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-87d348f6-2aef-4c31-991a-d2de7c754af3" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:10 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1G Jul 22 02:04:10 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-87d348f6-2aef-4c31-991a-d2de7c754af3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Deleting offline snapshot 87d348f6-2aef-4c31-991a-d2de7c754af3 of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] snapshot_file for this snap is: volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87e5e5c-fcbd-44dd-8b1d-ec82c9fc7cbd]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:10 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 Jul 22 02:04:10 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:10 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 1G" returned: 0 in 0.373s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Downloaded image 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 2f669c18-eb05-4d78-a0ca-8544c1a75060 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 for user a30cc8f8a9a7479cb9c21caabcef1271 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Marking volume 2f669c18-eb05-4d78-a0ca-8544c1a75060 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Copying metadata from image 24473c99-a605-4f38-8ab8-40745fe15ef5 to 2f669c18-eb05-4d78-a0ca-8544c1a75060. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Creating volume glance metadata for volume 2f669c18-eb05-4d78-a0ca-8544c1a75060 backed by image 24473c99-a605-4f38-8ab8-40745fe15ef5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce76cc3-161d-4027-9545-0b7fba2c69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f669c18-eb05-4d78-a0ca-8544c1a75060', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:10 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76fda78-1cc2-4b0b-b1a6-c6cf96c5fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:10 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Volume volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 (2f669c18-eb05-4d78-a0ca-8544c1a75060): created successfully Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76fda78-1cc2-4b0b-b1a6-c6cf96c5fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Flow 'volume_create_manager' (99ea316b-e15c-4162-bc5f-6d1f2445eb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[687857dc-301f-4b1c-8add-d1a5eb082163]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4963db76-4835-4afa-8297-5c58d2a86c02 tempest-VolumesExtendTest-1866118208 None] Created volume successfully. Jul 22 02:04:10 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:10 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating offline snapshot e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 of volume 23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05cf21b-2e0f-4868-ae27-e0387b9c9176]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:11 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 Jul 22 02:04:11 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:11 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:11 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 Jul 22 02:04:11 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:11 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949" returned: 0 in 0.419s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:11 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 1G Jul 22 02:04:11 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:11 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:11 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3 Jul 22 02:04:11 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:11 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 1G" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e820b0-b662-4614-b19a-6b18f0ded949 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:11 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e820b0-b662-4614-b19a-6b18f0ded949 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 Jul 22 02:04:11 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:11 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.87d348f6-2aef-4c31-991a-d2de7c754af3" returned: 0 in 0.262s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-87d348f6-2aef-4c31-991a-d2de7c754af3" released by "_delete_snapshot" :: held 1.668s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" released by "delete_snapshot" :: held 1.690s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Created reservations ['d6a5f2d8-37b9-47c9-a839-8c0b6ce17d53', 'a497d1a1-bb6e-462e-ad7c-858bf1391889', '35f44b94-ee4d-41da-bfb7-20fea0fb686b', '134eaff8-18f9-4531-81a8-21c86873f9b7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Delete snapshot completed successfully. Jul 22 02:04:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7a4c49c-cdce-4f99-8209-e0e1b9d1d4eb tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-87d348f6-2aef-4c31-991a-d2de7c754af3-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:12 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e820b0-b662-4614-b19a-6b18f0ded949 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" returned: 0 in 0.306s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:12 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 is being set with open permissions: ugo+rw Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 Jul 22 02:04:12 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-55023502-728c-4b45-a9c5-c3567a0d5efd-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:12 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-55023502-728c-4b45-a9c5-c3567a0d5efd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-55023502-728c-4b45-a9c5-c3567a0d5efd" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-55023502-728c-4b45-a9c5-c3567a0d5efd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Deleting offline snapshot 55023502-728c-4b45-a9c5-c3567a0d5efd of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] snapshot_file for this snap is: volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3a00fa-d2a5-4965-b048-0f619ff46faf]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info Jul 22 02:04:12 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:12 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:12 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:12 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:12 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info is being set with open permissions: ugo+rw Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info Jul 22 02:04:12 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:12 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b216a3c-4a3f-40f3-958f-3375dbc4f3b1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.info" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:12 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:12 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.603s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e3b4c1-1933-4bac-ab3a-4184d63eaff4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-afe6a408-dfdf-487f-9e62-986851820cc8 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Create snapshot completed successfully Jul 22 02:04:13 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 Jul 22 02:04:13 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:13 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:13 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:13 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:13 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060" returned: 0 in 0.382s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 2G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 2G" returned: 0 in 0.097s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.509s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c670d564-4066-4072-a944-6e400128bcb7 tempest-VolumesExtendTest-1866118208 None] Extend volume completed successfully. Jul 22 02:04:13 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:13 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd Jul 22 02:04:13 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:13 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.55023502-728c-4b45-a9c5-c3567a0d5efd" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-55023502-728c-4b45-a9c5-c3567a0d5efd" released by "_delete_snapshot" :: held 1.470s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" released by "delete_snapshot" :: held 1.498s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Created reservations ['dfea84d5-9e77-4d58-9c33-2f5ab6b7b6f4', 'af8f4cc3-4e1a-49d7-b9db-a5f9216fc162', '050355a5-31b5-4a54-873f-9c4744a5eae8', 'd689b203-3e9d-489c-846e-b515ad8cb496'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Delete snapshot completed successfully. Jul 22 02:04:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c3ad58ae-110f-42f4-a19b-d4564113779c tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-55023502-728c-4b45-a9c5-c3567a0d5efd-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (7e427bb9-c8a9-4415-8309-0ff493bff4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd196e-a669-4cfa-923a-cbc344f3bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafd196e-a669-4cfa-923a-cbc344f3bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101971249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1395a5-e35f-4c55-b0a6-609129d6130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:14Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334c209a-d29c-4ec7-b16f-1e20747fd138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334c209a-d29c-4ec7-b16f-1e20747fd138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8a3140-5b67-42fe-87f9-1c72977e0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8a3140-5b67-42fe-87f9-1c72977e0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1395a5-e35f-4c55-b0a6-609129d6130b', 'volume_name': 'volume-dd1395a5-e35f-4c55-b0a6-609129d6130b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d897d30-63b7-4a7f-9df7-0107fcb788a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d897d30-63b7-4a7f-9df7-0107fcb788a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68271ed2-f9be-4871-ae25-cda503a84ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:14 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume dd1395a5-e35f-4c55-b0a6-609129d6130b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1395a5-e35f-4c55-b0a6-609129d6130b', 'volume_size': 1} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101971249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1395a5-e35f-4c55-b0a6-609129d6130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:14Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume dd1395a5-e35f-4c55-b0a6-609129d6130b {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:14 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" acquired by "delete_snapshot" :: waited 0.155s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:14 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b 1073741824 Jul 22 02:04:14 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Deleting offline snapshot a98403f2-4338-4f05-a31d-e1d3d0b4c2ca of volume 19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] snapshot_file for this snap is: volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adec968-73fd-4c71-b62f-8398d013ba9e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-2f669c18-eb05-4d78-a0ca-8544c1a75060-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "cinder-2f669c18-eb05-4d78-a0ca-8544c1a75060-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-quobyte-2f669c18-eb05-4d78-a0ca-8544c1a75060" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-2f669c18-eb05-4d78-a0ca-8544c1a75060" acquired by "delete_volume" :: waited 0.048s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:14 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:14 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[85505dff-b7d3-4625-9a75-cb561be93284]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (46cdc98b-ff62-4c58-ae6c-65017e37c497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c892ad-6708-47c7-a0fb-5131ab3dae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 Jul 22 02:04:15 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c892ad-6708-47c7-a0fb-5131ab3dae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618899385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273b4728-4fb1-4c18-a302-7e23f9d8d3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:15Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec89f48f-bf4a-4875-9a16-d1749f472d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec89f48f-bf4a-4875-9a16-d1749f472d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218f89f0-aec5-435d-8e97-a7b9506f97ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218f89f0-aec5-435d-8e97-a7b9506f97ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '273b4728-4fb1-4c18-a302-7e23f9d8d3b7', 'volume_name': 'volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ed720d-f0e9-4ddf-8a23-8da981359b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ed720d-f0e9-4ddf-8a23-8da981359b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d8c988-8593-40e5-9849-b30c23ff99d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume 273b4728-4fb1-4c18-a302-7e23f9d8d3b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7', 'volume_size': 1} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:15 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b 1073741824" returned: 0 in 0.664s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:15 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:15 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b Jul 22 02:04:15 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (93cf529f-d54a-4055-8458-412178f60826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59695a51-d13c-4133-9aea-bdaaff24bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.661s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59695a51-d13c-4133-9aea-bdaaff24bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-258649823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c6747e-5987-496b-b12b-aaf4aa394f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:15Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af4602f-f077-4bb6-bca8-5bd0e609c384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af4602f-f077-4bb6-bca8-5bd0e609c384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5431f44-a5b8-4905-aff4-024face6b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5431f44-a5b8-4905-aff4-024face6b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c6747e-5987-496b-b12b-aaf4aa394f8d', 'volume_name': 'volume-12c6747e-5987-496b-b12b-aaf4aa394f8d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53808423-a6a5-40f1-83f6-540628db5696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53808423-a6a5-40f1-83f6-540628db5696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a20877-e9dd-4073-9d47-0e8210c02a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume 12c6747e-5987-496b-b12b-aaf4aa394f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c6747e-5987-496b-b12b-aaf4aa394f8d', 'volume_size': 1} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7178d076-b004-4c8f-871e-68ed3bef5779]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:15 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060" returned: 0 in 0.573s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:15 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060 Jul 22 02:04:15 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa Jul 22 02:04:15 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b" returned: 0 in 0.373s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618899385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273b4728-4fb1-4c18-a302-7e23f9d8d3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:15Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume 273b4728-4fb1-4c18-a302-7e23f9d8d3b7 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:15 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 1073741824 Jul 22 02:04:15 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68271ed2-f9be-4871-ae25-cda503a84ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1395a5-e35f-4c55-b0a6-609129d6130b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a576bbd-432e-4d1f-ae2f-529c2af8db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (a15f445d-19af-4af0-b010-e53bda5701d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299920b-a8fd-48fe-a2d5-110ef0c12793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-dd1395a5-e35f-4c55-b0a6-609129d6130b (dd1395a5-e35f-4c55-b0a6-609129d6130b): created successfully Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a576bbd-432e-4d1f-ae2f-529c2af8db97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (7e427bb9-c8a9-4415-8309-0ff493bff4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299920b-a8fd-48fe-a2d5-110ef0c12793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088630605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d20ac0-7cfd-413f-acef-b5cb0691c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:16Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78b6f0-fba0-49c0-96c6-cb0ddf327c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78b6f0-fba0-49c0-96c6-cb0ddf327c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbd7bc4-89e3-4d35-b630-79412d95c25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbd7bc4-89e3-4d35-b630-79412d95c25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d20ac0-7cfd-413f-acef-b5cb0691c2cf', 'volume_name': 'volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82e104-1fec-48ee-a544-9c505032505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd82e104-1fec-48ee-a544-9c505032505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7ea2eb-565f-4a7d-a94b-c64565f8f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume 26d20ac0-7cfd-413f-acef-b5cb0691c2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf', 'volume_size': 1} Jul 22 02:04:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:15 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3dbe2fb3-414b-4c1c-8ece-b3653e004ff2 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:16 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2f669c18-eb05-4d78-a0ca-8544c1a75060" returned: 0 in 0.464s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-2f669c18-eb05-4d78-a0ca-8544c1a75060" released by "delete_volume" :: held 1.087s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:16 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" returned: 0 in 0.618s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Created reservations ['7f950b39-b171-4b00-b124-91fbe0e73c29', 'b84dd350-a617-49e0-a385-6c2669e60424', '48091306-5f5a-4deb-a4ea-4147e3868b94', '3469f686-8e76-4f06-b68b-8c274be9913d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:16 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:16 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:16 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:16 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:16 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (59b6ab94-ddee-4d82-8076-cc5bf2a10f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5db0a8e-40f0-4a36-bc12-c1263f156d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 1073741824" returned: 0 in 0.638s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5db0a8e-40f0-4a36-bc12-c1263f156d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-872730620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd93957-c2da-4406-8fb5-94b60e786bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:16Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba6ee6f-70a5-4738-8629-8ad18f1b0d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba6ee6f-70a5-4738-8629-8ad18f1b0d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd35f70-d243-49ec-9690-c8d24267eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd35f70-d243-49ec-9690-c8d24267eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd93957-c2da-4406-8fb5-94b60e786bbc', 'volume_name': 'volume-8bd93957-c2da-4406-8fb5-94b60e786bbc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7fb8ff-01c2-4c7e-ae16-83f735a544ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7fb8ff-01c2-4c7e-ae16-83f735a544ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce9f1dc-d867-4257-aad3-24f76b855a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume 8bd93957-c2da-4406-8fb5-94b60e786bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd93957-c2da-4406-8fb5-94b60e786bbc', 'volume_size': 1} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:16 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 Jul 22 02:04:16 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:16 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.453s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:16 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Deleted volume successfully. Jul 22 02:04:16 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca Jul 22 02:04:16 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-54d6f04f-ccbf-49b7-81e5-759d3474271a tempest-VolumesExtendTest-1866118208 None] Lock "cinder-2f669c18-eb05-4d78-a0ca-8544c1a75060-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:16 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" returned: 0 in 0.269s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-258649823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c6747e-5987-496b-b12b-aaf4aa394f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:15Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume 12c6747e-5987-496b-b12b-aaf4aa394f8d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:16 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d8c988-8593-40e5-9849-b30c23ff99d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d 1073741824 Jul 22 02:04:16 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fb1fc-ccbe-4d37-bd65-f74372e10cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 (273b4728-4fb1-4c18-a302-7e23f9d8d3b7): created successfully Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd1fb1fc-ccbe-4d37-bd65-f74372e10cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (46cdc98b-ff62-4c58-ae6c-65017e37c497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7a2c30c3-4931-4387-9262-97e3a035348c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:16 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa.a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca" released by "_delete_snapshot" :: held 2.219s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" released by "delete_snapshot" :: held 2.272s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:16 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Created reservations ['a1f03972-cace-4a9e-b943-2429173c03e6', 'b89d0355-e8df-49a8-9455-7897a5575b1f', 'a3ff3f1c-68bf-4a85-bb0f-f730839fbf17', '7aae8d9c-7a36-430c-aae9-fd213c6d4655'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Delete snapshot completed successfully. Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-948bef6a-e819-4198-ae52-6bc36ee4906e tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-a98403f2-4338-4f05-a31d-e1d3d0b4c2ca-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:17 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d 1073741824" returned: 0 in 0.485s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:17 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d Jul 22 02:04:17 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:17 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088630605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d20ac0-7cfd-413f-acef-b5cb0691c2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:16Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume 26d20ac0-7cfd-413f-acef-b5cb0691c2cf {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:17 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:17 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf 1073741824 Jul 22 02:04:17 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a20877-e9dd-4073-9d47-0e8210c02a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c6747e-5987-496b-b12b-aaf4aa394f8d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e1fe82-63a2-4eb0-a866-cf69f1f1b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-12c6747e-5987-496b-b12b-aaf4aa394f8d (12c6747e-5987-496b-b12b-aaf4aa394f8d): created successfully Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e1fe82-63a2-4eb0-a866-cf69f1f1b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (93cf529f-d54a-4055-8458-412178f60826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Flow 'volume_create_manager' (b87156c0-968e-4398-932e-604fb7198e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d91088-aa03-42e2-bae8-8ed51d5405e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6efd8314-8b20-4a33-806d-2bfbe598fadb tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d91088-aa03-42e2-bae8-8ed51d5405e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1417765603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816547ee-af41-4b3c-b501-89335441a7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931bfff2801749a6b371de1e765d15ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:18Z,use_quota=True,user_id='a30cc8f8a9a7479cb9c21caabcef1271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a20cf-a6ef-41a2-9f83-e85cdeb71309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0a20cf-a6ef-41a2-9f83-e85cdeb71309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f762a15a-c002-4f9e-be27-1a9be57d7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f762a15a-c002-4f9e-be27-1a9be57d7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816547ee-af41-4b3c-b501-89335441a7da', 'volume_name': 'volume-816547ee-af41-4b3c-b501-89335441a7da', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41b027f-f85c-45a3-8b71-54ba2e22ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41b027f-f85c-45a3-8b71-54ba2e22ada8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1d295b-420b-43bf-b019-c2c6d763e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Volume 816547ee-af41-4b3c-b501-89335441a7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816547ee-af41-4b3c-b501-89335441a7da', 'volume_size': 1} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f39dc-2f40-4863-aad9-c21360c0965d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:18 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa Jul 22 02:04:18 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:18 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf 1073741824" returned: 0 in 0.529s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:18 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf Jul 22 02:04:18 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:18 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" returned: 0 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:18 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa Jul 22 02:04:18 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:18 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-872730620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd93957-c2da-4406-8fb5-94b60e786bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0418a197403b434fb6c806af1841eca8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:16Z,use_quota=True,user_id='f46ff62fb0d44370a1f2a4b9884eeda5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Creating volume 8bd93957-c2da-4406-8fb5-94b60e786bbc {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:18 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc 1073741824 Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7ea2eb-565f-4a7d-a94b-c64565f8f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:18 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6a5e44-e6c9-4f16-9809-c7d440bc31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf (26d20ac0-7cfd-413f-acef-b5cb0691c2cf): created successfully Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6a5e44-e6c9-4f16-9809-c7d440bc31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (a15f445d-19af-4af0-b010-e53bda5701d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-91cec5e5-38db-4f97-b741-a71b4e68580c tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:18 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-quobyte-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa" released by "delete_volume" :: held 0.749s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Created reservations ['d657f3c3-03a8-4e5c-af00-42a974ba333c', '4ed132d1-f6d3-430c-b4f0-7ca5e65f26aa', '5bd3bf6f-17d9-42ba-9fe8-cfc93ed08f71', '548c03b2-acb1-4ddb-93bf-b947e4e7446d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:18 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:18 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:18 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc 1073741824" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:19 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.270s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:19 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc Jul 22 02:04:19 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Deleted volume successfully. Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7ccecae2-302e-492f-b2ea-6969641b7a9d tempest-VolumesSnapshotListTestJSON-843623552 None] Lock "cinder-19f5198e-01ab-46fc-9ec3-abcd51d8ecfa-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:19 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1417765603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816547ee-af41-4b3c-b501-89335441a7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931bfff2801749a6b371de1e765d15ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:18Z,use_quota=True,user_id='a30cc8f8a9a7479cb9c21caabcef1271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Creating volume 816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:19 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce9f1dc-d867-4257-aad3-24f76b855a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd93957-c2da-4406-8fb5-94b60e786bbc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ff1f01-b566-43ed-87b9-7dc8279a7db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:19 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da 1073741824 Jul 22 02:04:19 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Volume volume-8bd93957-c2da-4406-8fb5-94b60e786bbc (8bd93957-c2da-4406-8fb5-94b60e786bbc): created successfully Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ff1f01-b566-43ed-87b9-7dc8279a7db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Flow 'volume_create_manager' (59b6ab94-ddee-4d82-8076-cc5bf2a10f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8acc4267-e6f6-4586-87f1-060b0a9ea6e3 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created volume successfully. Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-8bd93957-c2da-4406-8fb5-94b60e786bbc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-8bd93957-c2da-4406-8fb5-94b60e786bbc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-8bd93957-c2da-4406-8fb5-94b60e786bbc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-8bd93957-c2da-4406-8fb5-94b60e786bbc" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:19 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ef6c1-8b11-441a-ba8c-c1e96454b1da]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da 1073741824" returned: 0 in 0.589s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:19 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:19 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:20 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc Jul 22 02:04:20 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:20 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.282s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1d295b-420b-43bf-b019-c2c6d763e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816547ee-af41-4b3c-b501-89335441a7da', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4963b1bc-620e-4245-a6dc-8a3d9085b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Volume volume-816547ee-af41-4b3c-b501-89335441a7da (816547ee-af41-4b3c-b501-89335441a7da): created successfully Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4963b1bc-620e-4245-a6dc-8a3d9085b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Flow 'volume_create_manager' (b87156c0-968e-4398-932e-604fb7198e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a92d41ba-ef51-4ebc-b416-60f1c5067325 tempest-VolumesExtendTest-1866118208 None] Created volume successfully. Jul 22 02:04:20 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc" returned: 0 in 0.426s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:20 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc Jul 22 02:04:20 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:20 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8bd93957-c2da-4406-8fb5-94b60e786bbc" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-8bd93957-c2da-4406-8fb5-94b60e786bbc" released by "delete_volume" :: held 0.718s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['7a660dce-0c85-493b-939e-c22af5ab5a6b', '5c344049-0433-4185-ae4d-78b9c73e5b2d', '5cfa712a-fc4d-483c-ad02-efeeff7c85f8', '78133a74-88d5-4de3-9c66-846caf596623'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:20 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:20 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-26d20ac0-7cfd-413f-acef-b5cb0691c2cf-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:20 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.290s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:20 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-26d20ac0-7cfd-413f-acef-b5cb0691c2cf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8ab4d20b-8fdd-41d7-9ef8-c0384cfaf79e tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-8bd93957-c2da-4406-8fb5-94b60e786bbc-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[94857ca7-f068-4371-a9b3-2f5e2d1af75b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Creating offline snapshot 93021255-385e-44e5-805d-308e2fbebbf6 of volume 816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d22ca8-ef79-4718-b2af-b69cd48d66b5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:21 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf Jul 22 02:04:21 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:21 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:21 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:21 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" returned: 0 in 0.408s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:21 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:21 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:21 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:21 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 1G Jul 22 02:04:21 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:21 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" returned: 0 in 0.285s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-26d20ac0-7cfd-413f-acef-b5cb0691c2cf" released by "delete_volume" :: held 0.746s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:21 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['534d399b-0e81-4c32-838a-c2f004a2355b', '562f76fa-9115-415a-87af-035e2679a380', '4713cb0e-c657-481c-a850-840410bb212f', '3f9b9d26-f5f1-4d3d-857a-feade7feae7c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:22 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:22 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 1G" returned: 0 in 0.504s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-816547ee-af41-4b3c-b501-89335441a7da -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-816547ee-af41-4b3c-b501-89335441a7da -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 Jul 22 02:04:22 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-12c6747e-5987-496b-b12b-aaf4aa394f8d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-12c6747e-5987-496b-b12b-aaf4aa394f8d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-12c6747e-5987-496b-b12b-aaf4aa394f8d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-12c6747e-5987-496b-b12b-aaf4aa394f8d" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:22 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.421s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:22 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba55c0-3d2e-47ce-86b0-413e12fb4688]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3b56cf00-961c-45ea-81d7-e5648330fff9 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-26d20ac0-7cfd-413f-acef-b5cb0691c2cf-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:22 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-816547ee-af41-4b3c-b501-89335441a7da -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6" returned: 0 in 0.481s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:22 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 is being set with open permissions: ugo+rw Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d Jul 22 02:04:22 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:22 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 Jul 22 02:04:22 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:22 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:22 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d Jul 22 02:04:22 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:22 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info Jul 22 02:04:22 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:23 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-12c6747e-5987-496b-b12b-aaf4aa394f8d" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-12c6747e-5987-496b-b12b-aaf4aa394f8d" released by "delete_volume" :: held 0.776s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:23 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:23 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info is being set with open permissions: ugo+rw Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:23 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info Jul 22 02:04:23 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['daf46b1d-98a8-4756-a114-02f88ad924a2', '9e391188-6fae-4e00-b93b-986da543b909', '420c8d83-9bb3-426a-93e4-c360340ba6cb', 'd49e4f18-61a9-47ed-91c9-160ce6a1e9d2'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:23 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:23 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-273b4728-4fb1-4c18-a302-7e23f9d8d3b7-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:23 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.info" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-273b4728-4fb1-4c18-a302-7e23f9d8d3b7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2410b0ef-ac57-49c8-8dde-33ea463ec91f tempest-VolumesExtendTest-1866118208 None] Create snapshot completed successfully Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[50988620-b4fe-4931-9056-529a100ac50f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:23 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-3712ecfa-92bb-455d-b509-6f41bfebfcf5 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-12c6747e-5987-496b-b12b-aaf4aa394f8d-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:23 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 Jul 22 02:04:23 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:24 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:24 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7 Jul 22 02:04:24 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:24 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-273b4728-4fb1-4c18-a302-7e23f9d8d3b7" released by "delete_volume" :: held 0.709s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['3ba622be-77ee-4fea-ad30-0bd6f129fcb2', 'f840fbe3-da1b-4e9a-9f31-87bb025efccd', 'edb3b68d-04b0-453d-9d3b-c262370c6e72', 'c187fd82-47c0-40a8-95bb-f2194c678198'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b811a7-dff2-45a6-95eb-d4e16805f61c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:24 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:24 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:24 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:24 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-dd1395a5-e35f-4c55-b0a6-609129d6130b-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-dd1395a5-e35f-4c55-b0a6-609129d6130b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=150,cinder:UPDATE=162,cinder:INSERT=48,cinder:DELETE=17 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=178,cinder:INSERT=47,cinder:SELECT=141,cinder:DELETE=11 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:04:24 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.315s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-dd1395a5-e35f-4c55-b0a6-609129d6130b" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-dd1395a5-e35f-4c55-b0a6-609129d6130b" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:24 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9ec653a-6f80-49e9-b808-a3f53ac133b4 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-273b4728-4fb1-4c18-a302-7e23f9d8d3b7-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 2G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e1b68-f711-4210-b05c-80baa7de32e2]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 2G" returned: 0 in 0.119s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.593s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:25 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b Jul 22 02:04:25 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e692bd04-55c0-477f-9178-4de447eb672f tempest-VolumesExtendTest-1866118208 None] Extend volume completed successfully. Jul 22 02:04:25 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:25 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b Jul 22 02:04:25 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:25 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd1395a5-e35f-4c55-b0a6-609129d6130b" returned: 0 in 0.267s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-dd1395a5-e35f-4c55-b0a6-609129d6130b" released by "delete_volume" :: held 0.701s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['26283cb2-2401-407f-b14b-dee48fd812dd', 'b0ee9cb2-9daf-4583-8bfd-c941b24dfaf7', 'b9da62e6-6a51-408c-bf34-df9a5094cf9a', 'de42d130-2ef3-400c-9b94-4feb97b0c767'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-93021255-385e-44e5-805d-308e2fbebbf6-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-93021255-385e-44e5-805d-308e2fbebbf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-quobyte-93021255-385e-44e5-805d-308e2fbebbf6" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-93021255-385e-44e5-805d-308e2fbebbf6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Deleting offline snapshot 93021255-385e-44e5-805d-308e2fbebbf6 of volume 816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:25 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:25 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] snapshot_file for this snap is: volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8bd9a7-5840-49a2-b4fc-35e616ad119e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:25 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 Jul 22 02:04:25 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleting offline snapshot e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 of volume 23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] snapshot_file for this snap is: volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c78ed1-d097-4624-879a-83d99b31318a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:26 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:26 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 Jul 22 02:04:26 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d7cb9f94-bcb5-4478-af90-4a7e31f4b47a tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-dd1395a5-e35f-4c55-b0a6-609129d6130b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:26 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6" returned: 0 in 0.447s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-816547ee-af41-4b3c-b501-89335441a7da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfcd286-1423-4613-9d84-dd485ebdc7d3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:26 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:26 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:26 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" returned: 0 in 0.419s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e820b0-b662-4614-b19a-6b18f0ded949(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93ead0-0779-4fb6-a158-b2753a686427]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:26 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 Jul 22 02:04:26 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:26 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.400s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:26 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 Jul 22 02:04:26 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:26 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:26 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 Jul 22 02:04:26 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:27 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6" returned: 0 in 0.577s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:27 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6 Jul 22 02:04:27 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:27 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" returned: 0 in 0.499s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:27 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083 Jul 22 02:04:27 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:27 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da.93021255-385e-44e5-805d-308e2fbebbf6" returned: 0 in 0.289s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-93021255-385e-44e5-805d-308e2fbebbf6" released by "_delete_snapshot" :: held 1.857s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" released by "delete_snapshot" :: held 1.907s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949.e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" returned: 0 in 0.294s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083" released by "_delete_snapshot" :: held 1.751s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Created reservations ['e1e61e7b-a9c4-4f02-9152-c0f30cc53a70', '05345f0d-bd62-476b-a35d-d368e49bb9e1', '39378d70-c9c6-4c78-85f6-1c52ab1f4640', '5a005daf-6816-4809-aeb2-6adcdbc97f16'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" released by "delete_snapshot" :: held 1.785s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Delete snapshot completed successfully. Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['c30bebff-1d10-4103-af6f-f0bf619b7377', 'c90f2624-7876-4e8a-a37a-10153014ee38', 'a968ff8e-f01c-4082-8e62-a9cb35d08622', '71f0fdcc-b25f-4e90-987a-8434a685b284'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a05e54f6-8954-47b8-8e1f-aeaf905419db tempest-VolumesExtendTest-1866118208 None] Lock "cinder-93021255-385e-44e5-805d-308e2fbebbf6-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Delete snapshot completed successfully. Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6a0011b6-43f9-45eb-a186-02f14f91f8ae tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-e7c4b900-0bdb-408d-bdc8-3ec39ebdc083-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-816547ee-af41-4b3c-b501-89335441a7da-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "cinder-816547ee-af41-4b3c-b501-89335441a7da-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Acquiring lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-23e820b0-b662-4614-b19a-6b18f0ded949-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[15043aec-089f-41a2-b958-0bb9da429101]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-23e820b0-b662-4614-b19a-6b18f0ded949-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39c05f-efec-4662-bb80-14b9e9627fd7]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:28 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:28 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:28 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 Jul 22 02:04:28 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:28 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.436s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:28 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da Jul 22 02:04:28 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:28 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:28 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949 Jul 22 02:04:28 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:28 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-816547ee-af41-4b3c-b501-89335441a7da" returned: 0 in 0.306s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "cinder-quobyte-816547ee-af41-4b3c-b501-89335441a7da" released by "delete_volume" :: held 0.847s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Created reservations ['9655a2fe-bb86-4f4c-ad44-fd680ba9b79a', '2f0c69ad-4135-4b48-96b1-318c82c54760', 'dc68c41c-f473-4dd7-b598-5b3257edd4b4', '524fc78d-5cb7-4147-b26a-adadd17db477'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:29 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-23e820b0-b662-4614-b19a-6b18f0ded949" returned: 0 in 0.443s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:29 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:29 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-quobyte-23e820b0-b662-4614-b19a-6b18f0ded949" released by "delete_volume" :: held 0.976s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Created reservations ['d6a533f1-9940-4ec4-b59d-9e408b1870a2', '2cff2d69-b07d-4871-b365-3c011e96df96', 'b8830c28-fffc-425f-b51c-4496059581c1', 'c0a98440-cecf-4bce-8e82-773361c6c548'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:29 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:29 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:29 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.410s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Deleted volume successfully. Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eb534da5-a3bf-4f8d-b0a9-597c57f63d0d tempest-VolumesExtendTest-1866118208 None] Lock "cinder-816547ee-af41-4b3c-b501-89335441a7da-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:29 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Deleted volume successfully. Jul 22 02:04:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ea9688de-6d5d-4a42-9550-4474ea447c14 tempest-CreateVolumesFromSnapshotTest-1184816735 None] Lock "cinder-23e820b0-b662-4614-b19a-6b18f0ded949-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (7bc0ec98-1577-4723-bd6b-b983119a156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe1284b-e168-4f20-b6fb-aa349d760ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe1284b-e168-4f20-b6fb-aa349d760ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706524344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd105e-3fac-487f-81fa-837681d2c55c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:33Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413e84eb-e927-4b08-aba7-0141aaa7efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (413e84eb-e927-4b08-aba7-0141aaa7efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015a573-8e4c-4674-a440-558a594b096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015a573-8e4c-4674-a440-558a594b096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dd105e-3fac-487f-81fa-837681d2c55c', 'volume_name': 'volume-80dd105e-3fac-487f-81fa-837681d2c55c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21b95a6-0963-4b37-b70e-4bccb48a2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21b95a6-0963-4b37-b70e-4bccb48a2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c4a052-47f7-4799-bc7d-1cba2c148f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Volume 80dd105e-3fac-487f-81fa-837681d2c55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dd105e-3fac-487f-81fa-837681d2c55c', 'volume_size': 1} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706524344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd105e-3fac-487f-81fa-837681d2c55c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:33Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Creating volume 80dd105e-3fac-487f-81fa-837681d2c55c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:33 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:33 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c 1073741824 Jul 22 02:04:33 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:33 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c 1073741824" returned: 0 in 0.488s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:33 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c Jul 22 02:04:33 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:33 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c4a052-47f7-4799-bc7d-1cba2c148f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dd105e-3fac-487f-81fa-837681d2c55c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78c0fb-0b42-4cfd-be8c-c48e80c75e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:33 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Volume volume-80dd105e-3fac-487f-81fa-837681d2c55c (80dd105e-3fac-487f-81fa-837681d2c55c): created successfully Jul 22 02:04:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a78c0fb-0b42-4cfd-be8c-c48e80c75e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (7bc0ec98-1577-4723-bd6b-b983119a156a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a9327784-7687-4c69-a00c-aac909515d18 tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (5cf0e9ef-bfa1-4c68-a61b-978c4276406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fd8d7-db91-4d60-99c0-a1509283272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fd8d7-db91-4d60-99c0-a1509283272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-899687531',display_name='tempest-VolumesGetTest-Volume-1445103864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:36Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca158d53-b9e0-4779-856f-d964c6a3c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca158d53-b9e0-4779-856f-d964c6a3c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3cb307-a823-4d4a-887f-191730fabcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3cb307-a823-4d4a-887f-191730fabcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51', 'volume_name': 'volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d323ad20-ca42-440d-bb6b-731b15347920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:35 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d323ad20-ca42-440d-bb6b-731b15347920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f269b5-1ae7-433e-aafd-09c8dc0f1a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Volume ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51', 'volume_size': 1} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-899687531',display_name='tempest-VolumesGetTest-Volume-1445103864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:36Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Creating volume ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:36 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:36 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 1073741824 Jul 22 02:04:36 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:36 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 1073741824" returned: 0 in 0.510s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:36 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 Jul 22 02:04:36 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:36 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f269b5-1ae7-433e-aafd-09c8dc0f1a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e095604-64cb-4dfb-8980-c4a162b711a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Volume volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 (ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51): created successfully Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e095604-64cb-4dfb-8980-c4a162b711a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (5cf0e9ef-bfa1-4c68-a61b-978c4276406c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2f8e887e-6378-49db-9bf1-82991808ce3b tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Flow 'volume_create_manager' (bad4b9d9-5f7b-4503-b174-7ea982c51c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71993ce-d781-4a2c-a2b6-543deef568ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71993ce-d781-4a2c-a2b6-543deef568ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a1cddb75524c6e8d6396f0d513cfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:37Z,use_quota=True,user_id='8075cef321b94041918bcaec6d75f1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5809d1d-6d40-4c5b-9436-e7c964ff3b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5809d1d-6d40-4c5b-9436-e7c964ff3b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7023cb6f-5236-4fb0-bc72-48ccd2b02ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7023cb6f-5236-4fb0-bc72-48ccd2b02ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb', 'volume_name': 'volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb', 'volume_size': 1, 'image_id': '199921b4-5518-40e5-9845-e609c88f08ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7277efa92b1628dd7a0717fa2caa5102', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87a1cddb75524c6e8d6396f0d513cfac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4448742947ee2e8dc97be8d178fd380251cb39ce58ebcd9e706eefd1cd00a4817d402933ecb3fa266e39d0beb35dc07c7a68078cf265faba02ba57365837a35d', 'id': '199921b4-5518-40e5-9845-e609c88f08ec', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/199921b4-5518-40e5-9845-e609c88f08ec/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f446571-c8d0-4ff4-bc12-c4e23d81c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f446571-c8d0-4ff4-bc12-c4e23d81c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8cc217-d9bb-47b4-991c-696ab6fa7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb', 'volume_size': 1, 'image_id': '199921b4-5518-40e5-9845-e609c88f08ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7277efa92b1628dd7a0717fa2caa5102', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87a1cddb75524c6e8d6396f0d513cfac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4448742947ee2e8dc97be8d178fd380251cb39ce58ebcd9e706eefd1cd00a4817d402933ecb3fa266e39d0beb35dc07c7a68078cf265faba02ba57365837a35d', 'id': '199921b4-5518-40e5-9845-e609c88f08ec', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/199921b4-5518-40e5-9845-e609c88f08ec/file', 'properties': {}}, 'image_service': } Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Trying to clone b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb from image 199921b4-5518-40e5-9845-e609c88f08ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:04:37 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Image download 0.00 MB at 0.00 MB/s Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b8688-5a50-4093-95cd-2e5e4e041938]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:37 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:37 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:37 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:37 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:37 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:38 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Temporary image 199921b4-5518-40e5-9845-e609c88f08ec is fetched for user 8075cef321b94041918bcaec6d75f1b6. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "cinder-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab351b-a8f0-48be-a96d-422c92d1a2ac]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" acquired by "delete_volume" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c14bc4-5139-4aac-99f3-203fe7f31a9f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:38 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:38 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:38 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 Jul 22 02:04:38 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:38 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:38 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:38 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:38 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" returned: 0 in 0.484s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:39 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51 Jul 22 02:04:39 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:39 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a1cddb75524c6e8d6396f0d513cfac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:37Z,use_quota=True,user_id='8075cef321b94041918bcaec6d75f1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Creating volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:39 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:39 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1073741824 Jul 22 02:04:39 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:39 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51" released by "delete_volume" :: held 0.944s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Created reservations ['20462fbc-bac2-46a9-b922-9555ec0ed2ce', '39687c79-7c14-43b0-95b7-0a1b6c060c85', '20a28bd4-4a80-4646-b04b-77fd7e51111c', '1af4d819-b880-443f-b4d8-051b7141c5a5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:39 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:39 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:39 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1073741824" returned: 0 in 0.597s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:39 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb Jul 22 02:04:39 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:39 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.293s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:04:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c4d34b9c-8d98-417c-8bab-ac8b78cbbb9f tempest-VolumesGetTest-1089222757 None] Lock "cinder-ff8d3aae-a83c-4e80-a1ee-a36ee89d4f51-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:40 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" returned: 0 in 0.312s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Attempting download of 199921b4-5518-40e5-9845-e609c88f08ec ((None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}])) to volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca356a-0c77-4970-8ff2-862abbf0956d]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:40 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk Jul 22 02:04:40 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:40 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-80dd105e-3fac-487f-81fa-837681d2c55c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "cinder-80dd105e-3fac-487f-81fa-837681d2c55c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-80dd105e-3fac-487f-81fa-837681d2c55c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-80dd105e-3fac-487f-81fa-837681d2c55c" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:40 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk Jul 22 02:04:40 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[377aa116-cfe9-4d01-a028-484286a4b240]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:40 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c Jul 22 02:04:40 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:41 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk" returned: 1 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_199921b4-5518-40e5-9845-e609c88f08ec_0uhenpmk' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d8135d-7f00-4b17-898b-fd0382f1168a]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:41 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:41 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:41 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c" returned: 0 in 0.411s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:41 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c Jul 22 02:04:41 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:41 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:41 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-80dd105e-3fac-487f-81fa-837681d2c55c" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-80dd105e-3fac-487f-81fa-837681d2c55c" released by "delete_volume" :: held 0.805s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:41 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD Jul 22 02:04:41 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Created reservations ['b389b8e2-5c1c-4dfc-a6cf-8e9d9eddaf3d', '6d5e1dad-88c4-435d-aea4-f268b5f13dfe', 'f1e45b39-edc8-4eae-85e3-154a211564ff', 'e9a0f6f4-b76e-4793-8a8f-a08d86363a1a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:41 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:41 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:41 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] 199921b4-5518-40e5-9845-e609c88f08ec was raw, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:04:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:41 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb Jul 22 02:04:41 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:42 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.435s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-06c66e73-9b53-4eff-b50e-0bdaf37e0d8e tempest-VolumesGetTest-1089222757 None] Lock "cinder-80dd105e-3fac-487f-81fa-837681d2c55c-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:42 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" returned: 0 in 0.712s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_199921b4-5518-40e5-9845-e609c88f08ec_u3pkc8f9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:04:42 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:42 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1G Jul 22 02:04:42 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (c5643217-7d3d-4971-b8e4-4d87336cae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0282c0a-df83-4fe4-9f93-23befa28f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0282c0a-df83-4fe4-9f93-23befa28f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1895545980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23cf039-8e11-4d87-97f2-e9dedb3aaafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:43Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d944791a-2a7c-471d-b710-87e53e127061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d944791a-2a7c-471d-b710-87e53e127061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c659d4-13ca-4390-aa8f-958d7155a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c659d4-13ca-4390-aa8f-958d7155a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'volume_name': 'volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3ef0a-d38a-4c3e-a730-81964f19ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b3ef0a-d38a-4c3e-a730-81964f19ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8441f3b3-9c07-4c52-a248-9bcf0b2cdd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:42 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Volume d23cf039-8e11-4d87-97f2-e9dedb3aaafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'volume_size': 1} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1895545980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23cf039-8e11-4d87-97f2-e9dedb3aaafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:43Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Creating volume d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:42 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:42 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa 1073741824 Jul 22 02:04:42 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:42 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb 1G" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Downloaded image 199921b4-5518-40e5-9845-e609c88f08ec ((None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}])) to volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Temporary image 199921b4-5518-40e5-9845-e609c88f08ec for user 8075cef321b94041918bcaec6d75f1b6 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Marking volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Copying metadata from image 199921b4-5518-40e5-9845-e609c88f08ec to b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:04:42 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Creating volume glance metadata for volume b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb backed by image 199921b4-5518-40e5-9845-e609c88f08ec with: {'image_id': '199921b4-5518-40e5-9845-e609c88f08ec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7277efa92b1628dd7a0717fa2caa5102', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8cc217-d9bb-47b4-991c-696ab6fa7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb', 'volume_size': 1, 'image_id': '199921b4-5518-40e5-9845-e609c88f08ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/199921b4-5518-40e5-9845-e609c88f08ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7277efa92b1628dd7a0717fa2caa5102', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '87a1cddb75524c6e8d6396f0d513cfac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4448742947ee2e8dc97be8d178fd380251cb39ce58ebcd9e706eefd1cd00a4817d402933ecb3fa266e39d0beb35dc07c7a68078cf265faba02ba57365837a35d', 'id': '199921b4-5518-40e5-9845-e609c88f08ec', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/199921b4-5518-40e5-9845-e609c88f08ec/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e0c4d6-39a0-4b56-9f49-cd00aab2e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:43 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Volume volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb (b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb): created successfully Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e0c4d6-39a0-4b56-9f49-cd00aab2e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Flow 'volume_create_manager' (bad4b9d9-5f7b-4503-b174-7ea982c51c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2f9e85dd-55e0-4599-8c90-76bb1bcf2063 tempest-VolumeImageDependencyTests-1705829718 None] Created volume successfully. Jul 22 02:04:43 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa 1073741824" returned: 0 in 0.570s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:43 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:04:43 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Acquiring lock "cinder-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:43 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "cinder-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.300s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8441f3b3-9c07-4c52-a248-9bcf0b2cdd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfde89d0-a753-4e1a-bfba-00a42bffc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:43 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Volume volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa (d23cf039-8e11-4d87-97f2-e9dedb3aaafa): created successfully Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfde89d0-a753-4e1a-bfba-00a42bffc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (c5643217-7d3d-4971-b8e4-4d87336cae1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Acquiring lock "cinder-quobyte-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5ebcb6a4-913f-443d-8880-ee8a7bfe356e tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "cinder-quobyte-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eaef86-e091-498b-ad0a-763fa4928bd7]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:43 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb Jul 22 02:04:43 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:44 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:44 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb Jul 22 02:04:44 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:44 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" returned: 0 in 0.245s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "cinder-quobyte-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb" released by "delete_volume" :: held 0.684s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Created reservations ['3de90759-3ba0-42e8-8cdd-681d419c7138', '434e8417-b566-4a42-9ee9-5448ffbf660a', '6f995942-b793-48be-8446-9eb3749af5ab', 'c7570cd8-851c-430e-8f12-5d1a345916c0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:44 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:44 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:44 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:44 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Deleted volume successfully. Jul 22 02:04:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55dca6b4-5d49-4e2d-9323-1bcd93ffa4fe tempest-VolumeImageDependencyTests-1705829718 None] Lock "cinder-b97defc1-b5f1-4a9e-bfdc-2a8bdaa0fccb-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (eb0c8879-d8ce-471e-a486-3b5f93090bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae62570-6fab-4240-90fa-badca596a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae62570-6fab-4240-90fa-badca596a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1320403929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c430c732-3d0d-42dc-8415-d9b95d8dcb91,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d23cf039-8e11-4d87-97f2-e9dedb3aaafa,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:45Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e7141-0046-4bfd-a073-e1295ebbb344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092e7141-0046-4bfd-a073-e1295ebbb344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03692d6e-b591-4f3a-8705-d90f39414bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03692d6e-b591-4f3a-8705-d90f39414bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c430c732-3d0d-42dc-8415-d9b95d8dcb91', 'volume_name': 'volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91', 'volume_size': 1, 'source_volid': 'd23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'source_volstatus': 'available'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e308b464-2427-4805-8480-d764c07bea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e308b464-2427-4805-8480-d764c07bea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63ca28a-aff7-49b0-b734-565d88a3a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Volume c430c732-3d0d-42dc-8415-d9b95d8dcb91: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91', 'volume_size': 1, 'source_volid': 'd23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'source_volstatus': 'available'} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Cloning volume d23cf039-8e11-4d87-97f2-e9dedb3aaafa to volume c430c732-3d0d-42dc-8415-d9b95d8dcb91 Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Creating offline snapshot 9c18754d-b9f4-4f10-bc22-9d0549d9b92c of volume d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6138ffa2-f7e8-4877-ba47-e7a97a2e6fa8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:45 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:04:45 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:45 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.427s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:46 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c 1G Jul 22 02:04:46 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:46 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c 1G" returned: 0 in 0.553s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:46 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:46 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (5e22570f-0369-4737-b00f-6b1f87dfd2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4ae95-304d-47f9-b3e4-ae48ad6cf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4ae95-304d-47f9-b3e4-ae48ad6cf354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1528009033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7281472b-52b4-455f-9309-35bda98d8344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:47Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c5cd10-15a4-4ba1-9628-6858f0f8b2da),volume_type_id=51c5cd10-15a4-4ba1-9628-6858f0f8b2da)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047645a6-20f8-42c0-85ce-e6ff112b8a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047645a6-20f8-42c0-85ce-e6ff112b8a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca2be55-6de8-4deb-9b55-eee32881a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca2be55-6de8-4deb-9b55-eee32881a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7281472b-52b4-455f-9309-35bda98d8344', 'volume_name': 'volume-7281472b-52b4-455f-9309-35bda98d8344', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e62036e-d86e-4aa3-86e6-50e2bdb02736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e62036e-d86e-4aa3-86e6-50e2bdb02736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c9461b-d3e1-45e0-b99f-121ffcb761ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume 7281472b-52b4-455f-9309-35bda98d8344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7281472b-52b4-455f-9309-35bda98d8344', 'volume_size': 1} Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:46 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.383s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:46 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c is being set with open permissions: ugo+rw Jul 22 02:04:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:46 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:46 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (7f249f81-abf4-4b54-98da-b5226c2ddcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13264dfd-5b05-4a01-8cd0-b83a791230ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13264dfd-5b05-4a01-8cd0-b83a791230ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-142313314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4785da-0ba0-41fa-a4d9-48cff898e9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:47Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdcc8e13-9e9f-4209-b97a-a2f0132a7530),volume_type_id=bdcc8e13-9e9f-4209-b97a-a2f0132a7530)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15846999-b140-4873-bddc-e95b860451d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15846999-b140-4873-bddc-e95b860451d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f1616-3c75-47c9-828a-8907a9711132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f1616-3c75-47c9-828a-8907a9711132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4785da-0ba0-41fa-a4d9-48cff898e9cb', 'volume_name': 'volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e9f9d-27e4-4dd1-a3e9-75c73d7f5e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656e9f9d-27e4-4dd1-a3e9-75c73d7f5e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4660c7a1-d37f-4305-ad19-13bdfb77ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume 4d4785da-0ba0-41fa-a4d9-48cff898e9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb', 'volume_size': 1} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:47 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.331s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:47 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info Jul 22 02:04:47 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:47 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:47 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info is being set with open permissions: ugo+rw Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:47 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info Jul 22 02:04:47 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (a94e3872-fcd5-49a4-84a8-5466d4c74b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19a75e3-e956-477e-a334-b909c491693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19a75e3-e956-477e-a334-b909c491693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-444145525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd50ee-e409-4975-a3d9-b134e658e089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:48Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a66aa52-a42e-4ac6-8253-dd24e002cc18),volume_type_id=5a66aa52-a42e-4ac6-8253-dd24e002cc18)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4876bc-f923-438b-96ae-e3bd30685ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4876bc-f923-438b-96ae-e3bd30685ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e461a0-2ded-45f4-8bf0-c4dadac08da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:04:47 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.info" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] snapshot: 9c18754d-b9f4-4f10-bc22-9d0549d9b92c, volume: c430c732-3d0d-42dc-8415-d9b95d8dcb91, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657d48d-6c80-423b-a086-f12cb77981c4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:48 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:48 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e461a0-2ded-45f4-8bf0-c4dadac08da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ecfd50ee-e409-4975-a3d9-b134e658e089', 'volume_name': 'volume-ecfd50ee-e409-4975-a3d9-b134e658e089', 'volume_size': 1, 'image_id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1281739113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe032949167d4afbb6002ec818ea71f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a105997a-98e0-440d-a72f-192f1636ef00/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab89c70-7645-49cb-8ada-447a19789abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab89c70-7645-49cb-8ada-447a19789abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80ba90-db2e-40c8-a6a9-36928c32bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume ecfd50ee-e409-4975-a3d9-b134e658e089: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ecfd50ee-e409-4975-a3d9-b134e658e089', 'volume_size': 1, 'image_id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1281739113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe032949167d4afbb6002ec818ea71f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a105997a-98e0-440d-a72f-192f1636ef00/file', 'properties': {}}, 'image_service': } Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Trying to clone ecfd50ee-e409-4975-a3d9-b134e658e089 from image a105997a-98e0-440d-a72f-192f1636ef00 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:04:48 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.567s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8613d9-17d0-4c02-8f10-13bee7209a6a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Flow 'volume_create_manager' (80371063-3adf-44e3-81ec-97dd66da0642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27241496-141c-4e6d-84db-5ee8bee8d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27241496-141c-4e6d-84db-5ee8bee8d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f1a17-7270-459b-95bd-d0302cf93579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89c3a113b87479a88e713b762692ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:48Z,use_quota=True,user_id='84acacf299924232ace3d2ea0445403d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a329c00-ebb1-447a-9a2d-887d622da131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a329c00-ebb1-447a-9a2d-887d622da131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc79155-a988-4022-9bdd-8d44224a1595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc79155-a988-4022-9bdd-8d44224a1595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3f1a17-7270-459b-95bd-d0302cf93579', 'volume_name': 'volume-dd3f1a17-7270-459b-95bd-d0302cf93579', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff74d38b-840b-4e6a-9ed8-d2959c9139a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff74d38b-840b-4e6a-9ed8-d2959c9139a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8127592d-79b1-4bac-ad93-9d2f40b3fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Volume dd3f1a17-7270-459b-95bd-d0302cf93579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3f1a17-7270-459b-95bd-d0302cf93579', 'volume_size': 1} Jul 22 02:04:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:48 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:04:48 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:48 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.392s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:49 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:04:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:49 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 Jul 22 02:04:49 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:52 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:04:52 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:53 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.620s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:04:53 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91" returned: 0 in 4.880s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf2b3d-8f4f-4e5f-93ce-e870b8551b47]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:54 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:04:54 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD, size 20.69 MB, duration 6.04 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:04:54 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Image download 20.69 MB at 3.42 MB/s Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf42ee7-0c27-41ae-9ffe-b7899385e71e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:54 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD Jul 22 02:04:54 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:54 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.574s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:04:54 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Converted 1024.00 MB image at 209.80 MB/s Jul 22 02:04:54 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 is being set with open permissions: ugo+rw Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:54 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 Jul 22 02:04:54 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:54 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Temporary image a105997a-98e0-440d-a72f-192f1636ef00 is fetched for user 1a6dfce62c4f496bac7e6b13b8fb8cda. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:04:54 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" released by "_copy_volume_from_snapshot" :: held 6.771s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd27a93-02f5-4060-bd00-f1c2f31422dc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-9c18754d-b9f4-4f10-bc22-9d0549d9b92c" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-9c18754d-b9f4-4f10-bc22-9d0549d9b92c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Deleting offline snapshot 9c18754d-b9f4-4f10-bc22-9d0549d9b92c of volume d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] snapshot_file for this snap is: volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[14427fbc-b529-44af-8067-c20a2ad4df72]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:54 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD Jul 22 02:04:54 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:54 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:54 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:55 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:55 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.397s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38bb56-d6ae-4615-94a3-c4ed67bd4851]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:55 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:04:55 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:55 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:55 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:55 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:55 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.332s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:55 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c Jul 22 02:04:55 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:56 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa.9c18754d-b9f4-4f10-bc22-9d0549d9b92c" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-9c18754d-b9f4-4f10-bc22-9d0549d9b92c" released by "_delete_snapshot" :: held 1.421s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.758s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.536s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1528009033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7281472b-52b4-455f-9309-35bda98d8344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:47Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c5cd10-15a4-4ba1-9628-6858f0f8b2da),volume_type_id=51c5cd10-15a4-4ba1-9628-6858f0f8b2da)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Creating volume 7281472b-52b4-455f-9309-35bda98d8344 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:56 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:56 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 1073741824 Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63ca28a-aff7-49b0-b734-565d88a3a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91', 'volume_size': 1, 'source_volid': 'd23cf039-8e11-4d87-97f2-e9dedb3aaafa', 'source_volstatus': 'available'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:56 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e371b42b-e1e8-4de4-b02d-b34b1c7822ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:56 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Volume volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 (c430c732-3d0d-42dc-8415-d9b95d8dcb91): created successfully Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e371b42b-e1e8-4de4-b02d-b34b1c7822ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (eb0c8879-d8ce-471e-a486-3b5f93090bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:56 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2608482f-3ec5-42de-8cae-a47d022b45ce tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:04:56 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 1073741824" returned: 0 in 0.409s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:56 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 Jul 22 02:04:56 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:56 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344" returned: 0 in 0.245s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.733s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-142313314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4785da-0ba0-41fa-a4d9-48cff898e9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:47Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdcc8e13-9e9f-4209-b97a-a2f0132a7530),volume_type_id=bdcc8e13-9e9f-4209-b97a-a2f0132a7530)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Creating volume 4d4785da-0ba0-41fa-a4d9-48cff898e9cb {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:56 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c9461b-d3e1-45e0-b99f-121ffcb761ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7281472b-52b4-455f-9309-35bda98d8344', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:56 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb 1073741824 Jul 22 02:04:56 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce86f546-f427-4de5-9f53-32e38c04a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume volume-7281472b-52b4-455f-9309-35bda98d8344 (7281472b-52b4-455f-9309-35bda98d8344): created successfully Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce86f546-f427-4de5-9f53-32e38c04a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (5e22570f-0369-4737-b00f-6b1f87dfd2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4d568e6b-d302-42de-92f9-582e87a7cc19 tempest-TestInstancesWithCinderVolumes-1855785599 None] Created volume successfully. Jul 22 02:04:57 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb 1073741824" returned: 0 in 0.452s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:57 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb Jul 22 02:04:57 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:57 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.994s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f1a17-7270-459b-95bd-d0302cf93579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89c3a113b87479a88e713b762692ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:48Z,use_quota=True,user_id='84acacf299924232ace3d2ea0445403d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Creating volume dd3f1a17-7270-459b-95bd-d0302cf93579 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:57 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 1073741824 Jul 22 02:04:57 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4660c7a1-d37f-4305-ad19-13bdfb77ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66b20c9-4337-495e-946d-e0a6bc33a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb (4d4785da-0ba0-41fa-a4d9-48cff898e9cb): created successfully Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66b20c9-4337-495e-946d-e0a6bc33a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (7f249f81-abf4-4b54-98da-b5226c2ddcb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b9ad6f8a-cac6-43d8-8c4c-01821253eccb tempest-TestInstancesWithCinderVolumes-1855785599 None] Created volume successfully. Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (0dc68eeb-ba45-4661-b0c6-1a0c7bd1a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90800808-df50-4452-88f5-01ed3c5203c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90800808-df50-4452-88f5-01ed3c5203c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-829871487',display_name='tempest-VolumesGetTest-Volume-1798237205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95494ecc-de58-4de7-8798-d7540b99d770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:58Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76e315a-41b8-4310-bbcb-a07de0cfd6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76e315a-41b8-4310-bbcb-a07de0cfd6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1f7c-78ff-48c3-8e9f-d66260f74856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1f7c-78ff-48c3-8e9f-d66260f74856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95494ecc-de58-4de7-8798-d7540b99d770', 'volume_name': 'volume-95494ecc-de58-4de7-8798-d7540b99d770', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efcbdb1-6c21-4886-b882-55d0fee1b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efcbdb1-6c21-4886-b882-55d0fee1b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e7af6-99de-49e6-9088-1360d233e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Volume 95494ecc-de58-4de7-8798-d7540b99d770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95494ecc-de58-4de7-8798-d7540b99d770', 'volume_size': 1} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 1073741824" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:58 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 Jul 22 02:04:58 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:58 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-444145525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd50ee-e409-4975-a3d9-b134e658e089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe032949167d4afbb6002ec818ea71f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:48Z,use_quota=True,user_id='1a6dfce62c4f496bac7e6b13b8fb8cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a66aa52-a42e-4ac6-8253-dd24e002cc18),volume_type_id=5a66aa52-a42e-4ac6-8253-dd24e002cc18)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Creating volume ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8127592d-79b1-4bac-ad93-9d2f40b3fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3f1a17-7270-459b-95bd-d0302cf93579', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1073741824 Jul 22 02:04:58 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bdb527-88df-4a5e-89cd-d8fef455daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:04:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Volume volume-dd3f1a17-7270-459b-95bd-d0302cf93579 (dd3f1a17-7270-459b-95bd-d0302cf93579): created successfully Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bdb527-88df-4a5e-89cd-d8fef455daf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Flow 'volume_create_manager' (80371063-3adf-44e3-81ec-97dd66da0642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:04:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4206747d-f575-4e2f-bdd2-55344c6c2ee1 tempest-CinderUnicodeTest-1486786689 None] Created volume successfully. Jul 22 02:04:58 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1073741824" returned: 0 in 0.405s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:58 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 Jul 22 02:04:58 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:59 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:04:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-829871487',display_name='tempest-VolumesGetTest-Volume-1798237205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95494ecc-de58-4de7-8798-d7540b99d770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:04:58Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Creating volume 95494ecc-de58-4de7-8798-d7540b99d770 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:04:59 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:59 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 1073741824 Jul 22 02:04:59 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Attempting download of a105997a-98e0-440d-a72f-192f1636ef00 ((None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}])) to volume ecfd50ee-e409-4975-a3d9-b134e658e089. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[acceec4f-3ea6-4c83-940d-12e6ebdac31e]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:59 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt Jul 22 02:04:59 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:59 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt" returned: 0 in 0.336s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:59 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 1073741824" returned: 0 in 0.512s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:04:59 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt Jul 22 02:04:59 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:59 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 Jul 22 02:04:59 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:04:59 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt" returned: 1 in 0.360s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a105997a-98e0-440d-a72f-192f1636ef00_0mrp3bqt' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844417b-0ea0-4ba6-940a-c6d397fe81e5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:04:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:00 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05e7af6-99de-49e6-9088-1360d233e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95494ecc-de58-4de7-8798-d7540b99d770', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5057a-bc22-4a7c-9b86-b4252cd245a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD Jul 22 02:05:00 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Volume volume-95494ecc-de58-4de7-8798-d7540b99d770 (95494ecc-de58-4de7-8798-d7540b99d770): created successfully Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5057a-bc22-4a7c-9b86-b4252cd245a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (0dc68eeb-ba45-4661-b0c6-1a0c7bd1a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-35777f08-c7d9-4894-9452-d30a577c5a2a tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Flow 'volume_create_manager' (976c0c69-3f67-418b-b147-1be3412cf014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427444dd-3d09-4d5c-a383-0df8fca269a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427444dd-3d09-4d5c-a383-0df8fca269a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1854803663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ad7c9-d7b2-443a-af48-420b34d05e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89c3a113b87479a88e713b762692ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:00Z,use_quota=True,user_id='84acacf299924232ace3d2ea0445403d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395d1207-56e0-4f19-9dff-97cb2e57a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395d1207-56e0-4f19-9dff-97cb2e57a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627dc0e6-9aec-4d45-b299-cdc93c601fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627dc0e6-9aec-4d45-b299-cdc93c601fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240ad7c9-d7b2-443a-af48-420b34d05e2d', 'volume_name': 'volume-240ad7c9-d7b2-443a-af48-420b34d05e2d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749541c8-ec47-4951-97f4-1467ccc99e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749541c8-ec47-4951-97f4-1467ccc99e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd16ca69-8069-4981-b50b-3f5a6093425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Volume 240ad7c9-d7b2-443a-af48-420b34d05e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240ad7c9-d7b2-443a-af48-420b34d05e2d', 'volume_size': 1} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1854803663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ad7c9-d7b2-443a-af48-420b34d05e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89c3a113b87479a88e713b762692ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:00Z,use_quota=True,user_id='84acacf299924232ace3d2ea0445403d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Creating volume 240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:05:00 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:00 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] a105997a-98e0-440d-a72f-192f1636ef00 was qcow2, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:00 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d 1073741824 Jul 22 02:05:00 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:00 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 Jul 22 02:05:00 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:00 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d 1073741824" returned: 0 in 0.446s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:00 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d Jul 22 02:05:00 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:01 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd16ca69-8069-4981-b50b-3f5a6093425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240ad7c9-d7b2-443a-af48-420b34d05e2d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e36aa2-c043-4aca-b88f-65ec265fa224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Volume volume-240ad7c9-d7b2-443a-af48-420b34d05e2d (240ad7c9-d7b2-443a-af48-420b34d05e2d): created successfully Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e36aa2-c043-4aca-b88f-65ec265fa224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Flow 'volume_create_manager' (976c0c69-3f67-418b-b147-1be3412cf014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-16c9f726-5605-4bde-bf7d-021b9c2e92d8 tempest-CinderUnicodeTest-1486786689 None] Created volume successfully. Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-95494ecc-de58-4de7-8798-d7540b99d770-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "cinder-95494ecc-de58-4de7-8798-d7540b99d770-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-95494ecc-de58-4de7-8798-d7540b99d770" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-95494ecc-de58-4de7-8798-d7540b99d770" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c63c66-8c2b-4428-a83f-adc0415e456d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:01 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 Jul 22 02:05:01 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:01 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770" returned: 0 in 0.401s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:01 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770 Jul 22 02:05:01 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:02 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089" returned: 0 in 1.809s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a105997a-98e0-440d-a72f-192f1636ef00_5zs1r10adevstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:05:02 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Converted 112.00 MB image at 61.84 MB/s Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:02 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1G Jul 22 02:05:02 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:02 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-95494ecc-de58-4de7-8798-d7540b99d770" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-95494ecc-de58-4de7-8798-d7540b99d770" released by "delete_volume" :: held 0.757s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Created reservations ['10c82f63-5251-41e3-9d05-18572889afb2', 'ffd95ab9-9436-499a-bd58-89d20d45794f', '0d4743c0-c4d6-4285-bc52-af0263f7bb45', '18dbeb77-89fd-48ac-8dd1-f71d30ec0b08'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:02 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:02 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Creating offline snapshot 779f2498-c276-475f-bd69-6217eaa08aa4 of volume 240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da1d648-3f09-4151-952e-ea849d1cac52]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:02 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 1G" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Downloaded image a105997a-98e0-440d-a72f-192f1636ef00 ((None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}])) to volume ecfd50ee-e409-4975-a3d9-b134e658e089 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Temporary image a105997a-98e0-440d-a72f-192f1636ef00 for user 1a6dfce62c4f496bac7e6b13b8fb8cda is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Marking volume ecfd50ee-e409-4975-a3d9-b134e658e089 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Copying metadata from image a105997a-98e0-440d-a72f-192f1636ef00 to ecfd50ee-e409-4975-a3d9-b134e658e089. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Creating volume glance metadata for volume ecfd50ee-e409-4975-a3d9-b134e658e089 backed by image a105997a-98e0-440d-a72f-192f1636ef00 with: {'image_id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'image_name': 'tempest-scenario-img--1281739113', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:05:02 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d Jul 22 02:05:02 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-c430c732-3d0d-42dc-8415-d9b95d8dcb91-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80ba90-db2e-40c8-a6a9-36928c32bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfd50ee-e409-4975-a3d9-b134e658e089', 'volume_size': 1, 'image_id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a105997a-98e0-440d-a72f-192f1636ef00', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1281739113', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fe032949167d4afbb6002ec818ea71f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a105997a-98e0-440d-a72f-192f1636ef00', 'created_at': datetime.datetime(2026, 7, 22, 0, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 4, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a105997a-98e0-440d-a72f-192f1636ef00/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:02 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deab9b2-1230-4756-97e3-457a82bc4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.286s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:05:02 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Volume volume-ecfd50ee-e409-4975-a3d9-b134e658e089 (ecfd50ee-e409-4975-a3d9-b134e658e089): created successfully Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deab9b2-1230-4756-97e3-457a82bc4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Flow 'volume_create_manager' (a94e3872-fcd5-49a4-84a8-5466d4c74b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "cinder-c430c732-3d0d-42dc-8415-d9b95d8dcb91-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fff12f2d-3d3e-4364-8b9b-9019a8a7e264 tempest-TestInstancesWithCinderVolumes-1855785599 None] Created volume successfully. Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f33abfb6-7353-4660-bfb7-2c9645069e24 tempest-VolumesGetTest-1089222757 None] Lock "cinder-95494ecc-de58-4de7-8798-d7540b99d770-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a83c38-19e5-4094-8829-e52be44b3f42]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:02 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:02 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 1G Jul 22 02:05:02 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:02 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 Jul 22 02:05:02 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:03 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91" returned: 0 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:03 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91 Jul 22 02:05:03 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:03 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 1G" returned: 0 in 0.469s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240ad7c9-d7b2-443a-af48-420b34d05e2d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:03 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240ad7c9-d7b2-443a-af48-420b34d05e2d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 Jul 22 02:05:03 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:03 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c430c732-3d0d-42dc-8415-d9b95d8dcb91" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-c430c732-3d0d-42dc-8415-d9b95d8dcb91" released by "delete_volume" :: held 0.748s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Created reservations ['631ba0c0-5313-4e3f-9888-30bcbb95bb38', '20aa6271-dc1e-460c-bb0c-0ca2acd6180f', 'ebfbc940-f8dc-4ee8-9e6e-9a592472df7b', '5fd84716-5c15-44dd-9139-a14b46567b22'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:03 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:03 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:03 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240ad7c9-d7b2-443a-af48-420b34d05e2d -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4" returned: 0 in 0.365s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:03 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 is being set with open permissions: ugo+rw Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:03 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 Jul 22 02:05:03 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-d23cf039-8e11-4d87-97f2-e9dedb3aaafa-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "cinder-d23cf039-8e11-4d87-97f2-e9dedb3aaafa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:03 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:03 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1abcfe2c-3972-49b8-99fb-02abd0bdb8a9 tempest-VolumesGetTest-1089222757 None] Lock "cinder-c430c732-3d0d-42dc-8415-d9b95d8dcb91-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61e190-765e-418b-9d3d-58b14834c094]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:04 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:04 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info Jul 22 02:05:04 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:04 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:05:04 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:04 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info" returned: 0 in 0.322s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:04 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info is being set with open permissions: ugo+rw Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:04 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info Jul 22 02:05:04 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:04 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.486s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:04 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa Jul 22 02:05:04 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:04 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.info" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cf8c7b79-6a64-4602-9d3c-5cade6b65d81 tempest-CinderUnicodeTest-1486786689 None] Create snapshot completed successfully Jul 22 02:05:04 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" returned: 0 in 0.290s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-d23cf039-8e11-4d87-97f2-e9dedb3aaafa" released by "delete_volume" :: held 0.856s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:04 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Created reservations ['4191a087-3e79-4709-9fd7-20925d868c1a', 'a8bb6932-c49f-490e-8f0f-5f08edb5e6fb', '26a4fd3f-f31a-4d0c-a46c-9c6a47661acf', '8315b0ea-21f5-45f3-92b5-a94bed3809f7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:05 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:05 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:05 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.322s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1816ef77-6f0a-4efc-8997-359f18eff6cb tempest-VolumesGetTest-1089222757 None] Lock "cinder-d23cf039-8e11-4d87-97f2-e9dedb3aaafa-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-779f2498-c276-475f-bd69-6217eaa08aa4-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-779f2498-c276-475f-bd69-6217eaa08aa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-quobyte-779f2498-c276-475f-bd69-6217eaa08aa4" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-779f2498-c276-475f-bd69-6217eaa08aa4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Deleting offline snapshot 779f2498-c276-475f-bd69-6217eaa08aa4 of volume 240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] snapshot_file for this snap is: volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[73262e09-07cb-4bf2-9e1c-5eeef4b97c55]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-197a3c6d-9dbb-4cf6-8784-afe5703b4458 req-b3f12196-a945-41f8-bdca-9e322a74bed4 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-197a3c6d-9dbb-4cf6-8784-afe5703b4458 req-b3f12196-a945-41f8-bdca-9e322a74bed4 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-197a3c6d-9dbb-4cf6-8784-afe5703b4458 req-b3f12196-a945-41f8-bdca-9e322a74bed4 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-197a3c6d-9dbb-4cf6-8784-afe5703b4458 req-b3f12196-a945-41f8-bdca-9e322a74bed4 tempest-TestInstancesWithCinderVolumes-1855785599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-ecfd50ee-e409-4975-a3d9-b134e658e089', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '465dc029-f277-4d0b-bbdc-911ce785c367', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:05:06 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 Jul 22 02:05:06 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (d57e027d-2d42-4762-ad10-ab26f951fda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85f63d6-22a8-49ac-bcd9-9e232b7b2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85f63d6-22a8-49ac-bcd9-9e232b7b2b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1804105862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e4e149-e3c2-4d72-8f6f-a4302492c2aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:06Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986693a0-aa5e-441b-9daa-aee3fcb4871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986693a0-aa5e-441b-9daa-aee3fcb4871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3953fae0-485a-4143-8af7-a17b051baed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:05:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-197a3c6d-9dbb-4cf6-8784-afe5703b4458 req-b3f12196-a945-41f8-bdca-9e322a74bed4 tempest-TestInstancesWithCinderVolumes-1855785599 None] attachment_update completed successfully. Jul 22 02:05:06 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4" returned: 0 in 0.689s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240ad7c9-d7b2-443a-af48-420b34d05e2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b27cc-8521-4d1d-bb23-57dc728ab698]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3953fae0-485a-4143-8af7-a17b051baed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82e4e149-e3c2-4d72-8f6f-a4302492c2aa', 'volume_name': 'volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d0000b-c3e9-4ab5-864b-0d9bdb628f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d0000b-c3e9-4ab5-864b-0d9bdb628f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f344fad-6cfb-4639-b60b-8f791a698ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 02:05:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Trying to clone 82e4e149-e3c2-4d72-8f6f-a4302492c2aa from image 24473c99-a605-4f38-8ab8-40745fe15ef5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:05:06 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d Jul 22 02:05:06 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:05:07 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Image download 20.69 MB at 20.69 MB/s Jul 22 02:05:07 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d" returned: 0 in 0.549s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c80361-c0b3-45dd-9638-e7ca26dd7371]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:07 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 Jul 22 02:05:07 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:07 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD Jul 22 02:05:07 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:07 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:07 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 is fetched for user b802df643d3e47ddb369f9a45f8aebcd. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:05:07 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4 Jul 22 02:05:07 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033bc41-4ec8-4e02-b432-ff3e529b4723]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:07 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD Jul 22 02:05:07 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:07 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d.779f2498-c276-475f-bd69-6217eaa08aa4" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-779f2498-c276-475f-bd69-6217eaa08aa4" released by "_delete_snapshot" :: held 2.105s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" released by "delete_snapshot" :: held 2.132s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Created reservations ['56c8c08d-20a0-4b6e-bd8f-26a59b7fcea4', 'fd9ddb34-cc25-46da-8142-b0d3c6bd8284', '6da6d038-399c-4694-8feb-6d18a6bcd811', 'ee85dddc-b032-4fee-bfe1-a7743fb179ab'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:08 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1804105862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e4e149-e3c2-4d72-8f6f-a4302492c2aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:06Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Creating volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:05:08 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Delete snapshot completed successfully. Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-248e71c5-8076-477f-a11e-17ac89945667 tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-779f2498-c276-475f-bd69-6217eaa08aa4-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:08 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1073741824 Jul 22 02:05:08 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:08 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1073741824" returned: 0 in 0.540s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:08 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa Jul 22 02:05:08 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:09 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" returned: 0 in 0.430s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-240ad7c9-d7b2-443a-af48-420b34d05e2d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-240ad7c9-d7b2-443a-af48-420b34d05e2d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Attempting download of 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[660054fe-9683-438e-8c0d-21d77ec4a2e9]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" acquired by "delete_volume" :: waited 0.075s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24662a-5976-41a3-9d61-79723cf790c4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:09 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4 Jul 22 02:05:09 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:09 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d Jul 22 02:05:09 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:09 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4" returned: 0 in 0.664s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:10 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d" returned: 0 in 0.635s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:10 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d Jul 22 02:05:10 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:10 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4 Jul 22 02:05:10 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:10 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-240ad7c9-d7b2-443a-af48-420b34d05e2d" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:10 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-240ad7c9-d7b2-443a-af48-420b34d05e2d" released by "delete_volume" :: held 1.032s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4" returned: 1 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_k37fe1c4' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a2b25b-3d05-4fe3-a8ea-0322d0b6bdbb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Created reservations ['0261e726-0397-4ebd-a4ee-cb4138d86900', 'd01caf28-009b-4cfb-9d3e-6555b7fe09cc', 'a472be42-593f-4e15-97e3-9bcc58fe04ca', 'b79ba324-1c2f-458b-884c-017d084c60a4'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:10 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD Jul 22 02:05:10 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:10 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:10 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:10 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] 24473c99-a605-4f38-8ab8-40745fe15ef5 was qcow2, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:10 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Deleted volume successfully. Jul 22 02:05:10 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa Jul 22 02:05:10 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eebab48d-d804-4fa4-ba61-bcaffe2ccc1b tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-240ad7c9-d7b2-443a-af48-420b34d05e2d-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-dd3f1a17-7270-459b-95bd-d0302cf93579-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-dd3f1a17-7270-459b-95bd-d0302cf93579-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "cinder-quobyte-dd3f1a17-7270-459b-95bd-d0302cf93579" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-dd3f1a17-7270-459b-95bd-d0302cf93579" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a030e-e3ce-4eca-8c4d-6d83122299ff]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:11 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 Jul 22 02:05:11 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:12 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579" returned: 0 in 0.524s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:12 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579 Jul 22 02:05:12 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:12 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd3f1a17-7270-459b-95bd-d0302cf93579" returned: 0 in 0.421s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-quobyte-dd3f1a17-7270-459b-95bd-d0302cf93579" released by "delete_volume" :: held 1.009s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Created reservations ['6c01dba5-894c-4ceb-a1c3-cf4e97e05866', '45ab5464-82c3-48b2-bd09-700ee3076a48', 'c48d783f-c42b-400d-80ab-e77e7fbf9f0c', '48e3493e-f90b-4e9c-bc6c-d4d0edbb09c5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:12 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:12 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:13 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" returned: 0 in 2.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_b3bg7tq1devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:05:13 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Converted 112.00 MB image at 49.33 MB/s Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:13 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1G Jul 22 02:05:13 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:13 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Deleted volume successfully. Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-02963007-d9f4-4bca-8f8d-8f0bcf2eb13e tempest-CinderUnicodeTest-1486786689 None] Lock "cinder-dd3f1a17-7270-459b-95bd-d0302cf93579-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:13 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa 1G" returned: 0 in 0.425s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Downloaded image 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 for user b802df643d3e47ddb369f9a45f8aebcd is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Marking volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Copying metadata from image 24473c99-a605-4f38-8ab8-40745fe15ef5 to 82e4e149-e3c2-4d72-8f6f-a4302492c2aa. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Creating volume glance metadata for volume 82e4e149-e3c2-4d72-8f6f-a4302492c2aa backed by image 24473c99-a605-4f38-8ab8-40745fe15ef5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f344fad-6cfb-4639-b60b-8f791a698ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582f414-76c4-4b52-a4bd-302f05f5b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Volume volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa (82e4e149-e3c2-4d72-8f6f-a4302492c2aa): created successfully Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582f414-76c4-4b52-a4bd-302f05f5b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (d57e027d-2d42-4762-ad10-ab26f951fda6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-97963fce-2d8e-4bf1-b686-204e4e7c45d6 tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (212babd2-183d-42ff-ae65-1eb3068d8dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a617c-ce30-4d6f-a55d-0fcd7b196c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2a617c-ce30-4d6f-a55d-0fcd7b196c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688969382',display_name='tempest-VolumesGetTest-Volume-1297112218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:16Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0de81b3-4ce4-4a47-accd-8f4a742d290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0de81b3-4ce4-4a47-accd-8f4a742d290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510353a5-6933-4a76-b94a-28491107f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510353a5-6933-4a76-b94a-28491107f907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e', 'volume_name': 'volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22333580-294f-4b47-bea1-cec4e7cd05c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22333580-294f-4b47-bea1-cec4e7cd05c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad243f-cb50-43a2-9f3d-0af230a071e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Volume 5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e', 'volume_size': 1} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1688969382',display_name='tempest-VolumesGetTest-Volume-1297112218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0682d41945de4ef8949319db1b90d89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:16Z,use_quota=True,user_id='b802df643d3e47ddb369f9a45f8aebcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Creating volume 5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:05:16 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:05:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:16 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e 1073741824 Jul 22 02:05:16 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:17 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e 1073741824" returned: 0 in 0.638s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:17 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e Jul 22 02:05:17 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:17 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" returned: 0 in 0.322s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adad243f-cb50-43a2-9f3d-0af230a071e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5e3869-5ef1-4781-a3f7-9e07fdacb730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:17 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Volume volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e (5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e): created successfully Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5e3869-5ef1-4781-a3f7-9e07fdacb730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Flow 'volume_create_manager' (212babd2-183d-42ff-ae65-1eb3068d8dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-86edc7e4-8c91-4766-ad1f-326aa321ddc5 tempest-VolumesGetTest-1089222757 None] Created volume successfully. Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "cinder-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4417f-7e9b-4e2d-981e-cebae13714ff]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:18 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e Jul 22 02:05:18 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:19 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" returned: 0 in 0.618s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:19 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e Jul 22 02:05:19 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:19 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" returned: 0 in 0.462s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e" released by "delete_volume" :: held 1.146s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Created reservations ['82e4a433-d1a0-48af-8ed4-01adb9463956', 'a3468d0f-d301-42dd-b9bd-d8e89aeb2bee', '96e9f412-ddc1-4b5f-901f-f0eed8cf19a9', 'eb04464f-63de-44e6-b56a-6fa0e214bc83'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:20 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:20 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:20 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.426s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c48ddd1-bfe6-4b31-8e2a-4fcd50e77937 tempest-VolumesGetTest-1089222757 None] Lock "cinder-5f23ff4c-013f-4d1f-b6e2-fae5d5510f4e-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-82e4e149-e3c2-4d72-8f6f-a4302492c2aa-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "cinder-82e4e149-e3c2-4d72-8f6f-a4302492c2aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Acquiring lock "cinder-quobyte-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" acquired by "delete_volume" :: waited 0.038s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9369f2-ff89-40f0-8121-1a6b1302498f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:21 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa Jul 22 02:05:21 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:21 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" returned: 0 in 0.387s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:21 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa Jul 22 02:05:21 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:21 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "cinder-quobyte-82e4e149-e3c2-4d72-8f6f-a4302492c2aa" released by "delete_volume" :: held 0.742s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Created reservations ['93025324-cd68-442b-8d02-9e5f6fa1ea3d', '6fe34a25-6f60-41cb-b8db-5fd0a0f748b3', 'd4abf5cc-14b2-4e54-8db3-581017241def', '20ad1204-7796-45c8-9314-4df767d460fa'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:21 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:21 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:22 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:22 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:22 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Deleted volume successfully. Jul 22 02:05:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6fa2ba10-0ca5-4150-ba8b-92d1ad4a43aa tempest-VolumesGetTest-1089222757 None] Lock "cinder-82e4e149-e3c2-4d72-8f6f-a4302492c2aa-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:31 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=141,cinder:UPDATE=169,cinder:INSERT=51,cinder:DELETE=14 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:05:32 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=140,cinder:DELETE=14,cinder:UPDATE=173,cinder:INSERT=60 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:05:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-50234cc2-b9f3-4afe-80a5-59efaec3433f req-70ffb307-bdf4-4941-b8a9-8920e8182460 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-50234cc2-b9f3-4afe-80a5-59efaec3433f req-70ffb307-bdf4-4941-b8a9-8920e8182460 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-50234cc2-b9f3-4afe-80a5-59efaec3433f req-70ffb307-bdf4-4941-b8a9-8920e8182460 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:41 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-50234cc2-b9f3-4afe-80a5-59efaec3433f req-70ffb307-bdf4-4941-b8a9-8920e8182460 tempest-TestInstancesWithCinderVolumes-1855785599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-7281472b-52b4-455f-9309-35bda98d8344', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98dc086e-1953-431d-8d30-902116005874', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:05:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-50234cc2-b9f3-4afe-80a5-59efaec3433f req-70ffb307-bdf4-4941-b8a9-8920e8182460 tempest-TestInstancesWithCinderVolumes-1855785599 None] attachment_update completed successfully. Jul 22 02:05:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-e0e06a30-1f6d-4d85-bb63-749836da6e02 req-e4cd487c-012e-41ee-8e6e-a8776acda166 tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-e0e06a30-1f6d-4d85-bb63-749836da6e02 req-e4cd487c-012e-41ee-8e6e-a8776acda166 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-e0e06a30-1f6d-4d85-bb63-749836da6e02 req-e4cd487c-012e-41ee-8e6e-a8776acda166 tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-e0e06a30-1f6d-4d85-bb63-749836da6e02 req-e4cd487c-012e-41ee-8e6e-a8776acda166 tempest-TestInstancesWithCinderVolumes-1855785599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00adc4d9-7c37-4cc4-8c86-80564417c2d2', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:05:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-e0e06a30-1f6d-4d85-bb63-749836da6e02 req-e4cd487c-012e-41ee-8e6e-a8776acda166 tempest-TestInstancesWithCinderVolumes-1855785599 None] attachment_update completed successfully. Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Flow 'volume_create_manager' (daa80654-124c-4578-b0b7-f3071d5239c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9db675-f842-418f-8bce-7cf9de851f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9db675-f842-418f-8bce-7cf9de851f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1588505433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9718da770e4e79889ba98a9c353978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:46Z,use_quota=True,user_id='0f673a30447f4f029b7c2e101e164b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbb9372-773f-4fe5-8a8a-4b5064301e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbb9372-773f-4fe5-8a8a-4b5064301e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc623c5-530d-436e-8350-d8aaa871bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc623c5-530d-436e-8350-d8aaa871bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a', 'volume_name': 'volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b05d9e9-7bef-4b88-8541-6e62e3cf3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b05d9e9-7bef-4b88-8541-6e62e3cf3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81082f3-9e3d-4e7e-bea7-6a7b1088025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Volume 5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a', 'volume_size': 1} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1588505433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9718da770e4e79889ba98a9c353978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:46Z,use_quota=True,user_id='0f673a30447f4f029b7c2e101e164b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Creating volume 5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:05:46 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:46 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a 1073741824 Jul 22 02:05:46 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:46 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a 1073741824" returned: 0 in 0.482s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:46 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:05:46 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:47 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81082f3-9e3d-4e7e-bea7-6a7b1088025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fdb290-bd10-4c8b-864a-1ede71351f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Volume volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a (5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a): created successfully Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fdb290-bd10-4c8b-864a-1ede71351f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Flow 'volume_create_manager' (daa80654-124c-4578-b0b7-f3071d5239c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4566f8f9-335e-4add-9f87-b5ea68b11fcf tempest-SnapshotDependencyTests-1552582405 None] Created volume successfully. Jul 22 02:05:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Creating offline snapshot e870cc3f-6d78-4a42-a291-c5f5236fcc59 of volume 5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:05:48 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5034fc-ace4-415f-9250-3e49cb1eed32]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:48 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:05:48 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:49 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:49 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 1G Jul 22 02:05:49 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:49 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 1G" returned: 0 in 0.635s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:49 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:05:49 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:50 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 is being set with open permissions: ugo+rw Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:50 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:05:50 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:50 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:50 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info Jul 22 02:05:50 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:50 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info is being set with open permissions: ugo+rw Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:50 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info Jul 22 02:05:50 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:50 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.info" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cdbc9c37-19ac-4240-8edc-40c53edfd612 tempest-SnapshotDependencyTests-1552582405 None] Create snapshot completed successfully Jul 22 02:05:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-2de8f025-4aaf-4baa-91e8-21cbad49d6b1 req-0fb7f313-dac1-4aa5-857b-a57f4bb5ea68 tempest-TestInstancesWithCinderVolumes-1855785599 None] Terminate volume connection completed successfully. Jul 22 02:05:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-2de8f025-4aaf-4baa-91e8-21cbad49d6b1 req-0fb7f313-dac1-4aa5-857b-a57f4bb5ea68 tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleting attachment 98dc086e-1953-431d-8d30-902116005874. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-7281472b-52b4-455f-9309-35bda98d8344-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-7281472b-52b4-455f-9309-35bda98d8344-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-quobyte-7281472b-52b4-455f-9309-35bda98d8344" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-7281472b-52b4-455f-9309-35bda98d8344" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16fb13-9a3b-466b-80f3-f4d7ca5972ff]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:52 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 Jul 22 02:05:52 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:52 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:52 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Flow 'volume_create_manager' (c4aef0b5-1b87-414c-9ba7-1abb3d6e7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e044ff-3338-4b71-a29f-34a153c44580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e044ff-3338-4b71-a29f-34a153c44580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eddf8b-082c-4ff8-ac99-d92e454fc03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9718da770e4e79889ba98a9c353978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e870cc3f-6d78-4a42-a291-c5f5236fcc59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:05:53Z,use_quota=True,user_id='0f673a30447f4f029b7c2e101e164b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200231b0-dc00-4959-b654-a6bfec94c017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200231b0-dc00-4959-b654-a6bfec94c017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f066c9f-4b49-40c8-a84b-2053989922c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f066c9f-4b49-40c8-a84b-2053989922c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20eddf8b-082c-4ff8-ac99-d92e454fc03f', 'volume_name': 'volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f', 'volume_size': 1, 'snapshot_id': 'e870cc3f-6d78-4a42-a291-c5f5236fcc59'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1081f1b7-e33c-4e13-adc3-52ed575947c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1081f1b7-e33c-4e13-adc3-52ed575947c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88c62f6-739a-4cf8-8c8e-1c652b719c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:05:52 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Volume 20eddf8b-082c-4ff8-ac99-d92e454fc03f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f', 'volume_size': 1, 'snapshot_id': 'e870cc3f-6d78-4a42-a291-c5f5236fcc59'} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59-20eddf8b-082c-4ff8-ac99-d92e454fc03f" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59-20eddf8b-082c-4ff8-ac99-d92e454fc03f" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Creating volume 20eddf8b-082c-4ff8-ac99-d92e454fc03f from snapshot e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:52 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344" returned: 0 in 0.605s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:52 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.402s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:52 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344 Jul 22 02:05:52 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] snapshot: e870cc3f-6d78-4a42-a291-c5f5236fcc59, volume: 20eddf8b-082c-4ff8-ac99-d92e454fc03f, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8f580-3fd1-4fe6-ace4-0e8612b1ae7e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:53 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:05:53 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:53 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7281472b-52b4-455f-9309-35bda98d8344" returned: 0 in 0.295s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-7281472b-52b4-455f-9309-35bda98d8344" released by "delete_volume" :: held 0.972s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:53 devstack cinder-volume[87153]: WARNING cinder.quota [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160480998-1135456570 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160480998-1135456570, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:05:53 devstack cinder-volume[87153]: WARNING cinder.quota [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160480998-1135456570 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-160480998-1135456570, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Created reservations ['e263f730-d9ad-42c8-86c2-8f41b8d32ad9', 'c528f693-50f5-45d3-9b07-c697dfe9466d', '0d670b5d-85fc-4acb-935b-5f5745ee9890', '72f6bc5c-1348-4772-98fd-74e7539ac628'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:53 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:05:53 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:53 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.514s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4c5b0-2d87-4fea-a854-e1a6422e48fd]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:53 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:05:53 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:53 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.365s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:05:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleted volume successfully. Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-38538459-f621-47e6-893e-5d8a5c4212ae tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-7281472b-52b4-455f-9309-35bda98d8344-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:05:53 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.440s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:05:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:54 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f Jul 22 02:05:54 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-c075e796-b9a9-4b90-bb8e-0b0a67254973 req-b0c74a23-4102-451a-ac2a-04d362000d73 tempest-TestInstancesWithCinderVolumes-1855785599 None] Terminate volume connection completed successfully. Jul 22 02:05:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-c075e796-b9a9-4b90-bb8e-0b0a67254973 req-b0c74a23-4102-451a-ac2a-04d362000d73 tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleting attachment 00adc4d9-7c37-4cc4-8c86-80564417c2d2. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-4d4785da-0ba0-41fa-a4d9-48cff898e9cb-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-4d4785da-0ba0-41fa-a4d9-48cff898e9cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-quobyte-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c022354-1078-4857-a6ad-3d61c1ba15f8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:05:59 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb Jul 22 02:05:59 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:05:59 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f" returned: 0 in 5.977s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8cb906-d35e-4387-978c-bac73867d2ae]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:05:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:00 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:06:00 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:00 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" returned: 0 in 0.711s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:00 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb Jul 22 02:06:00 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:00 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" returned: 0 in 0.335s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-4d4785da-0ba0-41fa-a4d9-48cff898e9cb" released by "delete_volume" :: held 1.132s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:00 devstack cinder-volume[87153]: WARNING cinder.quota [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534985319-970343156 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534985319-970343156, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:06:00 devstack cinder-volume[87153]: WARNING cinder.quota [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534985319-970343156 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-534985319-970343156, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Created reservations ['1ba015d0-b64b-4907-b847-b8b163f90c46', 'c16849ef-6019-417e-a050-c1c9ea7866f1', '1dd28414-6b8e-4c3c-963a-eefb993832f4', '007a060b-7c9e-4067-a86d-6c5f660a4304'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:00 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.744s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:06:00 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Converted 1024.00 MB image at 171.30 MB/s Jul 22 02:06:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f is being set with open permissions: ugo+rw Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:00 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f Jul 22 02:06:00 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:00 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:00 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:01 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" released by "_copy_volume_from_snapshot" :: held 8.188s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59-20eddf8b-082c-4ff8-ac99-d92e454fc03f" released by "_create_volume_from_snapshot" :: held 8.265s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.291s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:01 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.370s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleted volume successfully. Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88c62f6-739a-4cf8-8c8e-1c652b719c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f', 'volume_size': 1, 'snapshot_id': 'e870cc3f-6d78-4a42-a291-c5f5236fcc59'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a64afcc-e0b0-4c6c-85f1-a6a645b1757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4d11aee1-8d58-4b47-8e25-db4e773b526c tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-4d4785da-0ba0-41fa-a4d9-48cff898e9cb-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Volume volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f (20eddf8b-082c-4ff8-ac99-d92e454fc03f): created successfully Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a64afcc-e0b0-4c6c-85f1-a6a645b1757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Flow 'volume_create_manager' (c4aef0b5-1b87-414c-9ba7-1abb3d6e7a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7b3415b7-2bd3-414b-9c15-332d3304c85a tempest-SnapshotDependencyTests-1552582405 None] Created volume successfully. Jul 22 02:06:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-e870cc3f-6d78-4a42-a291-c5f5236fcc59-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-e870cc3f-6d78-4a42-a291-c5f5236fcc59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Deleting offline snapshot e870cc3f-6d78-4a42-a291-c5f5236fcc59 of volume 5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] snapshot_file for this snap is: volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b5b4a-2fd7-4825-9ad2-416a44499386]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:02 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:06:02 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:02 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.559s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d29ae-d9f5-4ecc-8fe2-7a553243c5ae]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:02 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:06:02 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:03 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.746s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:03 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:06:03 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Flow 'volume_create_manager' (c4926a04-8ed3-40d6-b9c1-e99f37f85ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972bb1d4-dc53-4e0e-a48a-63d2b848b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972bb1d4-dc53-4e0e-a48a-63d2b848b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1789604613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024756e7-b254-4f9a-84f4-cdaf3f93a020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a379220716433cb434080dd583d610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:03Z,use_quota=True,user_id='ff609036c74f4fc980e47ea6ea856067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c0158-2850-471d-8aca-bd66c7e33764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c0158-2850-471d-8aca-bd66c7e33764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf219ef-0eaa-43be-b90e-2e850bf2e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:03 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:06:04 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.565s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:04 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59 Jul 22 02:06:04 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf219ef-0eaa-43be-b90e-2e850bf2e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '024756e7-b254-4f9a-84f4-cdaf3f93a020', 'volume_name': 'volume-024756e7-b254-4f9a-84f4-cdaf3f93a020', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0feb6ccb-fbc8-4444-892c-f7bca9a70ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0feb6ccb-fbc8-4444-892c-f7bca9a70ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d7847-9a3a-40d5-b19b-dc6054b9af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:04 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Volume 024756e7-b254-4f9a-84f4-cdaf3f93a020: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-024756e7-b254-4f9a-84f4-cdaf3f93a020', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Trying to clone 024756e7-b254-4f9a-84f4-cdaf3f93a020 from image 24473c99-a605-4f38-8ab8-40745fe15ef5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:06:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-713e8fa1-0c57-475f-b8de-6f74f8c0d082 req-38bb529c-5598-4794-b7cd-5c081d68a693 tempest-TestInstancesWithCinderVolumes-1855785599 None] Terminate volume connection completed successfully. Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-713e8fa1-0c57-475f-b8de-6f74f8c0d082 req-38bb529c-5598-4794-b7cd-5c081d68a693 tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleting attachment 465dc029-f277-4d0b-bbdc-911ce785c367. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:06:04 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a.e870cc3f-6d78-4a42-a291-c5f5236fcc59" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-e870cc3f-6d78-4a42-a291-c5f5236fcc59" released by "_delete_snapshot" :: held 2.435s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" released by "delete_snapshot" :: held 2.469s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Created reservations ['0d908ab6-e24a-41e1-ba90-9a76d81e7355', 'e44721c9-9c5f-4555-9d74-b81b82041928', '570f5c93-261c-478d-aee2-9fe23a009251', '95493dce-1357-42a4-94f1-9fd1cd599389'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:06:04 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Image download 20.69 MB at 20.69 MB/s Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2951e0-0f51-493d-9c57-9ed685749741]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Delete snapshot completed successfully. Jul 22 02:06:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d2702e57-29ef-424c-a6b8-b82466e9e3c3 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-e870cc3f-6d78-4a42-a291-c5f5236fcc59-delete_snapshot" released by "delete_snapshot" :: held 2.771s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:04 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD Jul 22 02:06:04 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 is fetched for user ff609036c74f4fc980e47ea6ea856067. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c91761-5609-4e3c-9328-b331c7154e94]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD Jul 22 02:06:05 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-ecfd50ee-e409-4975-a3d9-b134e658e089-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-ecfd50ee-e409-4975-a3d9-b134e658e089-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "cinder-quobyte-ecfd50ee-e409-4975-a3d9-b134e658e089" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-ecfd50ee-e409-4975-a3d9-b134e658e089" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" acquired by "delete_volume" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e3581a-6b2a-42b1-97de-89e7e929841d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da59c55-61c2-4a92-ab7d-2ce2031323a5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1789604613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024756e7-b254-4f9a-84f4-cdaf3f93a020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a379220716433cb434080dd583d610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:03Z,use_quota=True,user_id='ff609036c74f4fc980e47ea6ea856067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Creating volume 024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:05 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1073741824 Jul 22 02:06:05 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 Jul 22 02:06:05 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:06:05 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089" returned: 0 in 0.397s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:05 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a Jul 22 02:06:05 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:05 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089 Jul 22 02:06:05 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:06 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1073741824" returned: 0 in 0.474s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:06 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 Jul 22 02:06:06 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:06 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ecfd50ee-e409-4975-a3d9-b134e658e089" returned: 0 in 0.264s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-quobyte-ecfd50ee-e409-4975-a3d9-b134e658e089" released by "delete_volume" :: held 0.730s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" returned: 0 in 0.306s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a" released by "delete_volume" :: held 0.740s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:06 devstack cinder-volume[87153]: WARNING cinder.quota [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1709263857-849083096 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1709263857-849083096, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:06:06 devstack cinder-volume[87153]: WARNING cinder.quota [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1709263857-849083096 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1709263857-849083096, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Created reservations ['c31f07c4-3b6a-4a09-b31c-71f559f13a7c', '2b9fd500-c76e-4dbc-b8ce-142fc0cec380', '92709cb0-00e0-4104-aa3a-6a130216bf75', 'a4a7bdb8-1542-4532-8b19-25f2ac7065c5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Created reservations ['99253d25-d622-49bd-92d4-32f298ed586c', 'cd725c92-d6d7-442c-bd9e-7dccee26bac1', '4e0096e0-0391-4fa7-b40c-01c70ba5330b', '95fffe29-0bf6-4c54-87e8-2b7df4ccd61c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:06 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:06 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:06 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Attempting download of 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 024756e7-b254-4f9a-84f4-cdaf3f93a020. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:06:06 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:06 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2812c3fd-a6ca-4088-88f6-873853be2c14]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-20eddf8b-082c-4ff8-ac99-d92e454fc03f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-20eddf8b-082c-4ff8-ac99-d92e454fc03f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:06 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Deleted volume successfully. Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfebb57-f89b-4c5e-b6f1-cd9dc8b13744]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:06 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l Jul 22 02:06:06 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0a0fed8a-1c19-46b8-a4ea-889a2cf0a0ba tempest-TestInstancesWithCinderVolumes-1855785599 None] Lock "cinder-ecfd50ee-e409-4975-a3d9-b134e658e089-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:06 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Deleted volume successfully. Jul 22 02:06:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2838839c-2505-4813-be0c-e865a66a9062 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-5f9c3b3c-b00b-4fd6-8be1-6c3a9526ac2a-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:06 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f Jul 22 02:06:06 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l" returned: 0 in 0.495s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:07 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l Jul 22 02:06:07 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f" returned: 0 in 0.411s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:07 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f Jul 22 02:06:07 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l" returned: 1 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24473c99-a605-4f38-8ab8-40745fe15ef5_nrcraa_l' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad26ca-dd84-48cb-a5b2-4c90c8e5db73]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:07 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-20eddf8b-082c-4ff8-ac99-d92e454fc03f" returned: 0 in 0.271s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-quobyte-20eddf8b-082c-4ff8-ac99-d92e454fc03f" released by "delete_volume" :: held 0.755s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Created reservations ['0a32e6aa-dc73-458c-924a-700111df0cfe', '8abe70e2-28f1-4f2f-9ee9-a6885021ea6a', '2bbddbba-0c33-4590-8f9e-3d0fab2ceac1', '39a75b61-2653-4604-85e2-e2b57a1e5a8a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:07 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD Jul 22 02:06:07 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:07 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:07 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] 24473c99-a605-4f38-8ab8-40745fe15ef5 was qcow2, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:07 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 Jul 22 02:06:07 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:07 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.287s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Deleted volume successfully. Jul 22 02:06:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bfd31ab1-b379-4da1-9dbb-e8069b339221 tempest-SnapshotDependencyTests-1552582405 None] Lock "cinder-20eddf8b-082c-4ff8-ac99-d92e454fc03f-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:09 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020" returned: 0 in 2.062s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:09 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24473c99-a605-4f38-8ab8-40745fe15ef5_h71j5f2fdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:06:09 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Converted 112.00 MB image at 54.30 MB/s Jul 22 02:06:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:09 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1G Jul 22 02:06:09 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:10 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 1G" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Downloaded image 24473c99-a605-4f38-8ab8-40745fe15ef5 ((None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}])) to volume 024756e7-b254-4f9a-84f4-cdaf3f93a020 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Temporary image 24473c99-a605-4f38-8ab8-40745fe15ef5 for user ff609036c74f4fc980e47ea6ea856067 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Marking volume 024756e7-b254-4f9a-84f4-cdaf3f93a020 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Copying metadata from image 24473c99-a605-4f38-8ab8-40745fe15ef5 to 024756e7-b254-4f9a-84f4-cdaf3f93a020. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Creating volume glance metadata for volume 024756e7-b254-4f9a-84f4-cdaf3f93a020 backed by image 24473c99-a605-4f38-8ab8-40745fe15ef5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85d7847-9a3a-40d5-b19b-dc6054b9af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024756e7-b254-4f9a-84f4-cdaf3f93a020', 'volume_size': 1, 'image_id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24473c99-a605-4f38-8ab8-40745fe15ef5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4db30d1f6b3f493fa38f6e6b2b86d859', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24473c99-a605-4f38-8ab8-40745fe15ef5', 'created_at': datetime.datetime(2026, 7, 21, 23, 44, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 23, 44, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24473c99-a605-4f38-8ab8-40745fe15ef5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ca5ac-2c81-49e2-a2db-6611742ec5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:10 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Volume volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 (024756e7-b254-4f9a-84f4-cdaf3f93a020): created successfully Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5ca5ac-2c81-49e2-a2db-6611742ec5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Flow 'volume_create_manager' (c4926a04-8ed3-40d6-b9c1-e99f37f85ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-029fb4cd-087a-4613-897c-ea9f9e415124 tempest-TestShelveInstance-1623315683 None] Created volume successfully. Jul 22 02:06:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3a89bf94-0606-48cd-be8e-61b37e6fd592 req-e82928be-9e79-42dd-a54b-28d73e362837 tempest-TestShelveInstance-1623315683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3a89bf94-0606-48cd-be8e-61b37e6fd592 req-e82928be-9e79-42dd-a54b-28d73e362837 tempest-TestShelveInstance-1623315683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-3a89bf94-0606-48cd-be8e-61b37e6fd592 req-e82928be-9e79-42dd-a54b-28d73e362837 tempest-TestShelveInstance-1623315683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:17 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-3a89bf94-0606-48cd-be8e-61b37e6fd592 req-e82928be-9e79-42dd-a54b-28d73e362837 tempest-TestShelveInstance-1623315683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-024756e7-b254-4f9a-84f4-cdaf3f93a020', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '354f640c-1e67-48ff-927d-0b49b1a45400', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:06:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-3a89bf94-0606-48cd-be8e-61b37e6fd592 req-e82928be-9e79-42dd-a54b-28d73e362837 tempest-TestShelveInstance-1623315683 None] attachment_update completed successfully. Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (25b0754d-f786-47c3-b0b7-a3d388ab51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b04b67-b0cd-476b-8e4c-449c230d9bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b04b67-b0cd-476b-8e4c-449c230d9bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198344839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037e6c43-6047-4807-8155-f7cda7b2c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:21Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c84a2d7-4ea3-4681-bd5b-918a264a1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c84a2d7-4ea3-4681-bd5b-918a264a1729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af742063-aed9-494b-946a-70dcfefc7f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af742063-aed9-494b-946a-70dcfefc7f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037e6c43-6047-4807-8155-f7cda7b2c814', 'volume_name': 'volume-037e6c43-6047-4807-8155-f7cda7b2c814', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cee0e3d-597d-49a8-a801-052ed8f6e774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cee0e3d-597d-49a8-a801-052ed8f6e774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b51980-5e7f-44c2-93ed-d92cfe21a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume 037e6c43-6047-4807-8155-f7cda7b2c814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037e6c43-6047-4807-8155-f7cda7b2c814', 'volume_size': 1} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198344839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037e6c43-6047-4807-8155-f7cda7b2c814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:21Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume 037e6c43-6047-4807-8155-f7cda7b2c814 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:21 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:21 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 1073741824 Jul 22 02:06:21 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:21 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 1073741824" returned: 0 in 0.765s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:21 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 Jul 22 02:06:21 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:22 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b51980-5e7f-44c2-93ed-d92cfe21a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037e6c43-6047-4807-8155-f7cda7b2c814', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ab9cb8-edec-4c62-9d6f-62671f837d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-037e6c43-6047-4807-8155-f7cda7b2c814 (037e6c43-6047-4807-8155-f7cda7b2c814): created successfully Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ab9cb8-edec-4c62-9d6f-62671f837d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (25b0754d-f786-47c3-b0b7-a3d388ab51b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:22 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-218d6a35-d66f-40ce-9102-a599696b776f tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (1f5103d5-b00e-4fbd-b686-750d7292654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd159c-3fca-4cfb-baef-60725c0eeb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd159c-3fca-4cfb-baef-60725c0eeb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-477796375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358c29d1-9d39-435d-95c2-296cd135f195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:23Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c906dd0a-b84b-47bb-ac9f-92fe65c55063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c906dd0a-b84b-47bb-ac9f-92fe65c55063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4336ee-170e-45f9-9f9c-892a67986f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4336ee-170e-45f9-9f9c-892a67986f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358c29d1-9d39-435d-95c2-296cd135f195', 'volume_name': 'volume-358c29d1-9d39-435d-95c2-296cd135f195', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcbdf27-85c4-4b58-939b-5ea6b9b50ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcbdf27-85c4-4b58-939b-5ea6b9b50ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4735a04-b691-4dac-8645-ce455276e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume 358c29d1-9d39-435d-95c2-296cd135f195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358c29d1-9d39-435d-95c2-296cd135f195', 'volume_size': 1} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-477796375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358c29d1-9d39-435d-95c2-296cd135f195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:23Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume 358c29d1-9d39-435d-95c2-296cd135f195 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:23 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:23 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 1073741824 Jul 22 02:06:23 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (d1b82985-8ca5-4d9e-89e9-9d15737d0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46002546-874f-40bd-a2c7-1633aac28565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46002546-874f-40bd-a2c7-1633aac28565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88259676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47ae8ac-8354-46c9-a687-b6b5fa428434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:24Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2be533-a8fe-4ce3-b313-b25ed71e3d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2be533-a8fe-4ce3-b313-b25ed71e3d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30cdacc-a157-44d4-830d-f24fb1fd4692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30cdacc-a157-44d4-830d-f24fb1fd4692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47ae8ac-8354-46c9-a687-b6b5fa428434', 'volume_name': 'volume-c47ae8ac-8354-46c9-a687-b6b5fa428434', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f83620d-579e-4139-8d3c-056922706ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f83620d-579e-4139-8d3c-056922706ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880810d-1b87-4616-9b91-8db30a19059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume c47ae8ac-8354-46c9-a687-b6b5fa428434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47ae8ac-8354-46c9-a687-b6b5fa428434', 'volume_size': 1} Jul 22 02:06:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:24 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 1073741824" returned: 0 in 0.730s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:24 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 Jul 22 02:06:24 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (474a1877-84e3-4dc7-b9a4-d0e377a0523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c95c83-394a-454b-aa2e-4f03e80be078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c95c83-394a-454b-aa2e-4f03e80be078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004452357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6139567f-8712-4fb5-ab79-1d07bbb419ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:24Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e700ac-83b6-4d89-8145-38074ec77f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e700ac-83b6-4d89-8145-38074ec77f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8895a36c-2015-4599-93c6-b8e8b94949d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8895a36c-2015-4599-93c6-b8e8b94949d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6139567f-8712-4fb5-ab79-1d07bbb419ab', 'volume_name': 'volume-6139567f-8712-4fb5-ab79-1d07bbb419ab', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36107a38-0fec-47a2-9763-b4ba14c95085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36107a38-0fec-47a2-9763-b4ba14c95085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15704dac-9530-406d-8de5-ac8e52b082ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume 6139567f-8712-4fb5-ab79-1d07bbb419ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6139567f-8712-4fb5-ab79-1d07bbb419ab', 'volume_size': 1} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:24 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-88259676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47ae8ac-8354-46c9-a687-b6b5fa428434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:24Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume c47ae8ac-8354-46c9-a687-b6b5fa428434 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:24 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4735a04-b691-4dac-8645-ce455276e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358c29d1-9d39-435d-95c2-296cd135f195', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060be772-1604-4a93-86cf-217595338791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:24 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 1073741824 Jul 22 02:06:24 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:24 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-358c29d1-9d39-435d-95c2-296cd135f195 (358c29d1-9d39-435d-95c2-296cd135f195): created successfully Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060be772-1604-4a93-86cf-217595338791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (1f5103d5-b00e-4fbd-b686-750d7292654c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f9972c22-9b76-4343-b63c-17bcbf3b9a80 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (8bead3db-63a4-4506-ae83-4c73b10aeb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61737f04-bd02-4bed-9a5a-5e68814897aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61737f04-bd02-4bed-9a5a-5e68814897aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621192735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89908f7f-1f2a-48a2-8f2d-fcadaa7009e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:25Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d0efdd-92d1-4683-9758-29b61768529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d0efdd-92d1-4683-9758-29b61768529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dee860-ff4e-4355-929c-697b99ef215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dee860-ff4e-4355-929c-697b99ef215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89908f7f-1f2a-48a2-8f2d-fcadaa7009e3', 'volume_name': 'volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e0f2ad-a702-4f95-87d0-d7f14f96fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e0f2ad-a702-4f95-87d0-d7f14f96fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81784548-22e1-49ba-bdf3-7060897a5a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume 89908f7f-1f2a-48a2-8f2d-fcadaa7009e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3', 'volume_size': 1} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (43ecb036-3921-4692-8397-d6a6663e046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e6e03-06ac-48d3-a6af-dd8a146595c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 1073741824" returned: 0 in 0.928s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e6e03-06ac-48d3-a6af-dd8a146595c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409699541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e650e507-ff94-491e-95fa-7dbe8111fac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:26Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9b88b3-fc1d-414d-a4d8-bd4130a0c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9b88b3-fc1d-414d-a4d8-bd4130a0c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96050973-45bd-49a2-8d6b-0b1e0bcf707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96050973-45bd-49a2-8d6b-0b1e0bcf707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e650e507-ff94-491e-95fa-7dbe8111fac0', 'volume_name': 'volume-e650e507-ff94-491e-95fa-7dbe8111fac0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e9dde3-341b-4052-8395-814e4cd21822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e9dde3-341b-4052-8395-814e4cd21822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a3609-a232-427a-b6fa-ae9dcf03bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume e650e507-ff94-491e-95fa-7dbe8111fac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e650e507-ff94-491e-95fa-7dbe8111fac0', 'volume_size': 1} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:25 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 Jul 22 02:06:25 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:26 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434" returned: 0 in 0.300s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004452357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6139567f-8712-4fb5-ab79-1d07bbb419ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:24Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume 6139567f-8712-4fb5-ab79-1d07bbb419ab {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f880810d-1b87-4616-9b91-8db30a19059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47ae8ac-8354-46c9-a687-b6b5fa428434', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c02184-f18d-4af7-9c42-4b4cbc61903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:26 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab 1073741824 Jul 22 02:06:26 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 (c47ae8ac-8354-46c9-a687-b6b5fa428434): created successfully Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c02184-f18d-4af7-9c42-4b4cbc61903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (d1b82985-8ca5-4d9e-89e9-9d15737d0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9d24b0f6-dffe-4a80-a486-fbefc2752ee9 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:26 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab 1073741824" returned: 0 in 0.565s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:26 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab Jul 22 02:06:26 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:26 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621192735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89908f7f-1f2a-48a2-8f2d-fcadaa7009e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:25Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume 89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15704dac-9530-406d-8de5-ac8e52b082ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6139567f-8712-4fb5-ab79-1d07bbb419ab', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe54c816-886a-4e8b-87ae-71588b6ee166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:26 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 1073741824 Jul 22 02:06:26 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-6139567f-8712-4fb5-ab79-1d07bbb419ab (6139567f-8712-4fb5-ab79-1d07bbb419ab): created successfully Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe54c816-886a-4e8b-87ae-71588b6ee166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (474a1877-84e3-4dc7-b9a4-d0e377a0523f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f1bd169a-e409-4542-a82d-7fcba92abae8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:27 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 1073741824" returned: 0 in 0.563s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:27 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 Jul 22 02:06:27 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:27 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" returned: 0 in 0.345s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1409699541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e650e507-ff94-491e-95fa-7dbe8111fac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c777ce0ded4e409f9dd1e95bb46f7e3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:06:26Z,use_quota=True,user_id='f93184af12c84be19c28322e7dd8a9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Creating volume e650e507-ff94-491e-95fa-7dbe8111fac0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:06:27 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81784548-22e1-49ba-bdf3-7060897a5a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:27 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 1073741824 Jul 22 02:06:27 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d951fab-9439-4409-af20-2a5bcc3041be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 (89908f7f-1f2a-48a2-8f2d-fcadaa7009e3): created successfully Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d951fab-9439-4409-af20-2a5bcc3041be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (8bead3db-63a4-4506-ae83-4c73b10aeb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-df4ea580-e529-41b1-ba99-be88d2e70132 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:28 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 1073741824" returned: 0 in 0.487s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:28 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 Jul 22 02:06:28 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:28 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0" returned: 0 in 0.245s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a3609-a232-427a-b6fa-ae9dcf03bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e650e507-ff94-491e-95fa-7dbe8111fac0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45874099-8439-42dd-885f-f53c8267a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:06:28 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Volume volume-e650e507-ff94-491e-95fa-7dbe8111fac0 (e650e507-ff94-491e-95fa-7dbe8111fac0): created successfully Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45874099-8439-42dd-885f-f53c8267a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:06:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Flow 'volume_create_manager' (43ecb036-3921-4692-8397-d6a6663e046f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:06:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-24da5e2d-390e-497f-9b1c-1448b83f71db tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created volume successfully. Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-e650e507-ff94-491e-95fa-7dbe8111fac0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-e650e507-ff94-491e-95fa-7dbe8111fac0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-e650e507-ff94-491e-95fa-7dbe8111fac0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-e650e507-ff94-491e-95fa-7dbe8111fac0" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3474eb99-d242-42c9-af42-bf27af5d4662]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:29 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 Jul 22 02:06:29 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:29 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0" returned: 0 in 0.375s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:29 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0 Jul 22 02:06:29 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:29 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e650e507-ff94-491e-95fa-7dbe8111fac0" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-e650e507-ff94-491e-95fa-7dbe8111fac0" released by "delete_volume" :: held 0.689s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['15fbd006-7831-4e72-a40c-63c3486203a1', '27b0a4ba-9d8b-43f6-92da-291737d4c088', 'f9f2f15c-a583-4332-b3d6-05d3e54ce859', '344dccfe-a337-481e-9da7-c43681643cb3'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:29 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:29 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:30 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fd742d4b-d2f8-4e71-88b3-fd91002250b1 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-e650e507-ff94-491e-95fa-7dbe8111fac0-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1992aa-dd90-4a26-9bcf-583bfd597af5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:30 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 Jul 22 02:06:30 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:30 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" returned: 0 in 0.375s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:30 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3 Jul 22 02:06:30 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:30 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" returned: 0 in 0.262s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3" released by "delete_volume" :: held 0.676s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['efe2b5f3-89a2-4a4c-ba58-b83b38176bb8', '94633e5d-9f71-4170-8b32-6423a0ab1427', '21644afd-9138-4267-97d8-e7881932e1db', 'b6052107-ee7b-444d-a801-ba3cd96be271'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:31 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:31 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:31 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-6139567f-8712-4fb5-ab79-1d07bbb419ab-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8302ce3e-479a-4f33-850e-8d394965cf7c tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-89908f7f-1f2a-48a2-8f2d-fcadaa7009e3-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-6139567f-8712-4fb5-ab79-1d07bbb419ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-6139567f-8712-4fb5-ab79-1d07bbb419ab" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-6139567f-8712-4fb5-ab79-1d07bbb419ab" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1a238-9cb4-4a9e-b259-28deb786dd95]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:31 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab Jul 22 02:06:31 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:31 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab" returned: 0 in 0.366s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:31 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab Jul 22 02:06:31 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:32 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6139567f-8712-4fb5-ab79-1d07bbb419ab" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-6139567f-8712-4fb5-ab79-1d07bbb419ab" released by "delete_volume" :: held 0.668s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=91,cinder:UPDATE=100,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['b7f32dc1-f2e7-4f7c-8b71-a1ed0689aaae', '9f402a94-a498-40a1-9e2f-ed3bbada26a0', '4b77a4db-cb7c-4f53-b160-f4a38d592ecd', '655be096-c4ea-48a2-8a6e-898773b31ea7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=102,cinder:UPDATE=94,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:32 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:32 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:32 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.271s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-c47ae8ac-8354-46c9-a687-b6b5fa428434-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ff1d7997-18f6-4c06-9acd-dea307d0e300 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-6139567f-8712-4fb5-ab79-1d07bbb419ab-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-c47ae8ac-8354-46c9-a687-b6b5fa428434-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-c47ae8ac-8354-46c9-a687-b6b5fa428434" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-c47ae8ac-8354-46c9-a687-b6b5fa428434" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7658be-5baf-42a7-8a81-184ae1f6e99f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:32 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 Jul 22 02:06:32 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:33 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434" returned: 0 in 0.380s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:33 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434 Jul 22 02:06:33 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:33 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c47ae8ac-8354-46c9-a687-b6b5fa428434" returned: 0 in 0.259s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-c47ae8ac-8354-46c9-a687-b6b5fa428434" released by "delete_volume" :: held 0.679s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['d26bf032-d469-4023-954a-b670b6fb6a90', 'ca139040-0d34-41ee-b450-3e620f4e0e3c', '7ba21631-0e11-415d-86fe-abb5c19823de', '5f347ec3-fe98-4761-912d-1fe000a0470f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:33 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:33 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:33 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d4e60852-1a84-45c4-bdf6-7c8f4aa641d8 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-c47ae8ac-8354-46c9-a687-b6b5fa428434-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-358c29d1-9d39-435d-95c2-296cd135f195-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-358c29d1-9d39-435d-95c2-296cd135f195-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-358c29d1-9d39-435d-95c2-296cd135f195" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-358c29d1-9d39-435d-95c2-296cd135f195" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbbfb52-a21a-4594-87d9-c3995a9aaf8d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:34 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 Jul 22 02:06:34 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:34 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:34 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195 Jul 22 02:06:34 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:34 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-358c29d1-9d39-435d-95c2-296cd135f195" returned: 0 in 0.259s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-358c29d1-9d39-435d-95c2-296cd135f195" released by "delete_volume" :: held 0.668s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['e4cc993c-d3cc-4fcf-b6ab-6aac5d8f3077', '0bab8307-bb7e-4fa4-a189-16893d9de586', 'c77aadac-1ee9-45ee-9de2-66089adf9a7c', '5a427136-1008-495b-b948-e9387d00d59c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:34 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:34 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:34 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.267s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:34 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-55be86a1-9e3c-4af5-b4cc-2e752fccdb7d tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-358c29d1-9d39-435d-95c2-296cd135f195-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-037e6c43-6047-4807-8155-f7cda7b2c814-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-037e6c43-6047-4807-8155-f7cda7b2c814-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "cinder-quobyte-037e6c43-6047-4807-8155-f7cda7b2c814" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-037e6c43-6047-4807-8155-f7cda7b2c814" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[134acb87-ddee-4feb-8c7c-f6e0d950bb70]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:35 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 Jul 22 02:06:35 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:35 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:35 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814 Jul 22 02:06:35 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:35 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-037e6c43-6047-4807-8155-f7cda7b2c814" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-quobyte-037e6c43-6047-4807-8155-f7cda7b2c814" released by "delete_volume" :: held 0.672s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Created reservations ['8107ef30-9214-4a6f-b098-6fdb1cba153c', 'e7bd7167-f347-4e7c-b856-cf7255e16698', '23e09269-681d-4904-9be3-803ade4eac5e', '34ee9d38-0feb-4911-a1c2-c7e429275e58'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:35 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:35 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:36 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:36 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Deleted volume successfully. Jul 22 02:06:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-69a20dec-bfcf-4bc0-8056-551d3e75e198 tempest-CreateVolumesFromSourceVolumeTest-495278803 None] Lock "cinder-037e6c43-6047-4807-8155-f7cda7b2c814-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:06:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:INSERT=10,cinder:UPDATE=36,cinder:SELECT=18,cinder:DELETE=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:06:46 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:DELETE=2,cinder:SELECT=14,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:06:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-8df14707-588a-44c5-8be3-f146a2a02b36 req-34ff2e4b-3d47-4add-a57a-5ec356bd2a24 tempest-TestShelveInstance-1623315683 None] Terminate volume connection completed successfully. Jul 22 02:06:49 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-8df14707-588a-44c5-8be3-f146a2a02b36 req-34ff2e4b-3d47-4add-a57a-5ec356bd2a24 tempest-TestShelveInstance-1623315683 None] Deleting attachment 354f640c-1e67-48ff-927d-0b49b1a45400. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-39f89ce0-3afe-4344-9b34-b46fe0163b8c req-992b4861-8792-4883-8983-e8730a3f7bee tempest-TestShelveInstance-1623315683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-39f89ce0-3afe-4344-9b34-b46fe0163b8c req-992b4861-8792-4883-8983-e8730a3f7bee tempest-TestShelveInstance-1623315683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-39f89ce0-3afe-4344-9b34-b46fe0163b8c req-992b4861-8792-4883-8983-e8730a3f7bee tempest-TestShelveInstance-1623315683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-39f89ce0-3afe-4344-9b34-b46fe0163b8c req-992b4861-8792-4883-8983-e8730a3f7bee tempest-TestShelveInstance-1623315683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e', 'name': 'volume-024756e7-b254-4f9a-84f4-cdaf3f93a020', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c833af17-2973-47d7-adbd-952e99225644', 'enforce_multipath': True} {{(pid=87153) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 22 02:06:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-39f89ce0-3afe-4344-9b34-b46fe0163b8c req-992b4861-8792-4883-8983-e8730a3f7bee tempest-TestShelveInstance-1623315683 None] attachment_update completed successfully. Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:06:52 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:06:52 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:06:52 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:06:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:07:11 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:07:11 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:07:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-d6301e3a-61a7-4760-92a1-465585ee04cb tempest-TestShelveInstance-1623315683 None] Terminate volume connection completed successfully. Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-d6301e3a-61a7-4760-92a1-465585ee04cb tempest-TestShelveInstance-1623315683 None] Deleting attachment c833af17-2973-47d7-adbd-952e99225644. {{(pid=87153) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Acquiring lock "cinder-024756e7-b254-4f9a-84f4-cdaf3f93a020-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "cinder-024756e7-b254-4f9a-84f4-cdaf3f93a020-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Acquiring lock "cinder-quobyte-024756e7-b254-4f9a-84f4-cdaf3f93a020" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "cinder-quobyte-024756e7-b254-4f9a-84f4-cdaf3f93a020" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3fa8cf-4c28-457e-932d-b2c188370256]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:19 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 Jul 22 02:07:19 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:20 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:20 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020 Jul 22 02:07:20 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:20 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-024756e7-b254-4f9a-84f4-cdaf3f93a020" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "cinder-quobyte-024756e7-b254-4f9a-84f4-cdaf3f93a020" released by "delete_volume" :: held 0.662s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.quota [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Created reservations ['dd8085e8-396e-497d-b053-1034aa80b755', '86b3c18b-03a2-467e-aa13-5c01a2ca4005', '4517f21a-9484-497e-9ce0-3ddc3df29b40', 'a63d63a0-9458-4f87-9a30-bd8231404738'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:20 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:20 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:20 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.248s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.manager [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Deleted volume successfully. Jul 22 02:07:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [req-180a2626-d45b-4b51-8a24-0729f9a08de0 req-7556b7ea-adde-4b1b-aa7c-cb8e02956914 tempest-TestShelveInstance-1623315683 None] Lock "cinder-024756e7-b254-4f9a-84f4-cdaf3f93a020-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:30 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:07:30 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Flow 'volume_create_manager' (8f97360d-2199-45f4-9cd2-13d6cf17a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e79135-882a-4fe7-bdd5-adeab1fdee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e79135-882a-4fe7-bdd5-adeab1fdee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e2b175-05c0-4397-9b35-7742a3419941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e6b5fbd9184413bad985814ab7b636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:34Z,use_quota=True,user_id='7dd4cb40f5144123a8a7921bd156ac54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a224cd9-9377-41ec-bdd8-05ca16b5c07a),volume_type_id=0a224cd9-9377-41ec-bdd8-05ca16b5c07a)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b91db-b1cd-4f39-8bf9-37f5aa5b1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b91db-b1cd-4f39-8bf9-37f5aa5b1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bf2d78-d90d-40be-8f16-08d517952cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bf2d78-d90d-40be-8f16-08d517952cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93e2b175-05c0-4397-9b35-7742a3419941', 'volume_name': 'volume-93e2b175-05c0-4397-9b35-7742a3419941', 'volume_size': 1, 'image_id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46a4a7d7c43f5f84c992175826716707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e6b5fbd9184413bad985814ab7b636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff4c613981d03930d4fa8f87a7edf7b964deaaf2061266e4148d3594940fd11e32dbc911b21b93bb572189c21c74df4df5f038e6eb44a4262e28abc7c94b398c', 'id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'created_at': datetime.datetime(2026, 7, 22, 0, 7, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 7, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85a1b25-2611-4aad-b84a-ae4fb5a1043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85a1b25-2611-4aad-b84a-ae4fb5a1043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bdfb58-4ec2-4fd9-8b38-1cc88e3ef9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:34 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Volume 93e2b175-05c0-4397-9b35-7742a3419941: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93e2b175-05c0-4397-9b35-7742a3419941', 'volume_size': 1, 'image_id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46a4a7d7c43f5f84c992175826716707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e6b5fbd9184413bad985814ab7b636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff4c613981d03930d4fa8f87a7edf7b964deaaf2061266e4148d3594940fd11e32dbc911b21b93bb572189c21c74df4df5f038e6eb44a4262e28abc7c94b398c', 'id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'created_at': datetime.datetime(2026, 7, 22, 0, 7, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 7, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Trying to clone 93e2b175-05c0-4397-9b35-7742a3419941 from image b17ce775-84f0-4425-8dfd-74a63e8e92ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:07:34 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Image download 0.00 MB at 0.00 MB/s Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db0493-43bb-424a-927f-3e470a1f879b]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:35 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:35 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:35 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:35 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:35 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:35 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Temporary image b17ce775-84f0-4425-8dfd-74a63e8e92ed is fetched for user 7dd4cb40f5144123a8a7921bd156ac54. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[670e1cf2-cf4f-4063-b4f9-b4edccada079]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:35 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:35 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:35 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:36 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:36 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:36 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93e2b175-05c0-4397-9b35-7742a3419941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e6b5fbd9184413bad985814ab7b636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:34Z,use_quota=True,user_id='7dd4cb40f5144123a8a7921bd156ac54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a224cd9-9377-41ec-bdd8-05ca16b5c07a),volume_type_id=0a224cd9-9377-41ec-bdd8-05ca16b5c07a)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Creating volume 93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:36 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:36 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1073741824 Jul 22 02:07:36 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:36 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1073741824" returned: 0 in 0.401s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:36 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 Jul 22 02:07:36 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:37 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Attempting download of b17ce775-84f0-4425-8dfd-74a63e8e92ed ((None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}])) to volume 93e2b175-05c0-4397-9b35-7742a3419941. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a46a40-7f4f-4ccd-9500-808ab493a0e1]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:37 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w Jul 22 02:07:37 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:37 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w" returned: 0 in 0.318s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:37 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w Jul 22 02:07:37 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:37 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w" returned: 1 in 0.318s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b17ce775-84f0-4425-8dfd-74a63e8e92ed_68tqqw3w' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fce899-3e00-4d22-8bea-205c4504b841]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:37 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:37 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:38 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:38 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD Jul 22 02:07:38 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:38 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] b17ce775-84f0-4425-8dfd-74a63e8e92ed was raw, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:38 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 Jul 22 02:07:38 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:38 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941" returned: 0 in 0.424s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b17ce775-84f0-4425-8dfd-74a63e8e92ed_x9wrcgf5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:07:38 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 02:07:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:38 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1G Jul 22 02:07:38 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:39 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 1G" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Downloaded image b17ce775-84f0-4425-8dfd-74a63e8e92ed ((None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}])) to volume 93e2b175-05c0-4397-9b35-7742a3419941 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Temporary image b17ce775-84f0-4425-8dfd-74a63e8e92ed for user 7dd4cb40f5144123a8a7921bd156ac54 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Marking volume 93e2b175-05c0-4397-9b35-7742a3419941 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Copying metadata from image b17ce775-84f0-4425-8dfd-74a63e8e92ed to 93e2b175-05c0-4397-9b35-7742a3419941. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Creating volume glance metadata for volume 93e2b175-05c0-4397-9b35-7742a3419941 backed by image b17ce775-84f0-4425-8dfd-74a63e8e92ed with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '46a4a7d7c43f5f84c992175826716707', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bdfb58-4ec2-4fd9-8b38-1cc88e3ef9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e2b175-05c0-4397-9b35-7742a3419941', 'volume_size': 1, 'image_id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46a4a7d7c43f5f84c992175826716707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e6b5fbd9184413bad985814ab7b636', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff4c613981d03930d4fa8f87a7edf7b964deaaf2061266e4148d3594940fd11e32dbc911b21b93bb572189c21c74df4df5f038e6eb44a4262e28abc7c94b398c', 'id': 'b17ce775-84f0-4425-8dfd-74a63e8e92ed', 'created_at': datetime.datetime(2026, 7, 22, 0, 7, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 7, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b17ce775-84f0-4425-8dfd-74a63e8e92ed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6da67-4836-4213-a0d0-19dea2a8a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:39 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Volume volume-93e2b175-05c0-4397-9b35-7742a3419941 (93e2b175-05c0-4397-9b35-7742a3419941): created successfully Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad6da67-4836-4213-a0d0-19dea2a8a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Flow 'volume_create_manager' (8f97360d-2199-45f4-9cd2-13d6cf17a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dac194c3-69f5-4201-a842-4292cb6eff5e tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Created volume successfully. Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Acquiring lock "cinder-93e2b175-05c0-4397-9b35-7742a3419941-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "cinder-93e2b175-05c0-4397-9b35-7742a3419941-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Acquiring lock "cinder-quobyte-93e2b175-05c0-4397-9b35-7742a3419941" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "cinder-quobyte-93e2b175-05c0-4397-9b35-7742a3419941" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1efb5-7b7a-4b3e-a2d1-2f93c78c624d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:39 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 Jul 22 02:07:39 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:40 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:40 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941 Jul 22 02:07:40 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:40 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-93e2b175-05c0-4397-9b35-7742a3419941" returned: 0 in 0.251s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "cinder-quobyte-93e2b175-05c0-4397-9b35-7742a3419941" released by "delete_volume" :: held 0.647s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:40 devstack cinder-volume[87153]: WARNING cinder.quota [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:07:40 devstack cinder-volume[87153]: WARNING cinder.quota [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Created reservations ['3547acd9-e9b1-414e-a3e7-fc804b93a884', '7157d239-d590-45a5-9a00-dcc720c8ea81', 'e0547bb0-25d9-44a4-bc3f-95c081b76f3e', '8606489a-e1f9-4165-a18e-c755633bb9f3'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:40 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:40 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:40 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.237s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Deleted volume successfully. Jul 22 02:07:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-13c5d7bd-aa87-411f-9fa5-092be677d016 tempest-VolumeAndVolumeTypeFromImageTest-717818591 None] Lock "cinder-93e2b175-05c0-4397-9b35-7742a3419941-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:44 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (d5b0f918-7c3d-4078-b5d4-9a5a027fdcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7a674-a75a-47a3-ba79-12eb2294c0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:44 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7a674-a75a-47a3-ba79-12eb2294c0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267181312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c87407-d40b-476b-bec7-5eadf67c01bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:45Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2275088c-0685-44e9-8999-d24eeecd52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2275088c-0685-44e9-8999-d24eeecd52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9505ba-ae4d-41a1-88fa-5cf54a4610fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9505ba-ae4d-41a1-88fa-5cf54a4610fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c87407-d40b-476b-bec7-5eadf67c01bb', 'volume_name': 'volume-31c87407-d40b-476b-bec7-5eadf67c01bb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e395af35-5850-4f9b-ae3b-d9d5014eaba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e395af35-5850-4f9b-ae3b-d9d5014eaba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008f6501-fc72-4e4e-86b0-36c4723420d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Volume 31c87407-d40b-476b-bec7-5eadf67c01bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c87407-d40b-476b-bec7-5eadf67c01bb', 'volume_size': 1} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267181312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c87407-d40b-476b-bec7-5eadf67c01bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:45Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Creating volume 31c87407-d40b-476b-bec7-5eadf67c01bb {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:45 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb 1073741824 Jul 22 02:07:45 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (4f92a437-df23-4624-8831-bdd3f0704f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2c17c9-4f92-4a52-8485-a5b4ec5404c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2c17c9-4f92-4a52-8485-a5b4ec5404c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070508016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f20d3e5-f6e2-4ace-a17b-519d0b234b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:45Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf5bdb8-4942-4620-9459-f60c989972b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf5bdb8-4942-4620-9459-f60c989972b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a11f64-7ec3-4c95-bdfc-dac0f238f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a11f64-7ec3-4c95-bdfc-dac0f238f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f20d3e5-f6e2-4ace-a17b-519d0b234b63', 'volume_name': 'volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e1e3-7ddb-4dc6-b9cd-423c2fb9d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e1e3-7ddb-4dc6-b9cd-423c2fb9d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b31ae3a-be12-44b8-9f61-4eb1831190dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Volume 0f20d3e5-f6e2-4ace-a17b-519d0b234b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63', 'volume_size': 1} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:45 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb 1073741824" returned: 0 in 0.492s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:45 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb Jul 22 02:07:45 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (aaff0ab2-7e09-40a5-a8f3-48d7bbad7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b574cce3-c069-4190-b49b-74bf2ea7a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b574cce3-c069-4190-b49b-74bf2ea7a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204879499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2d4ba-8399-459c-905a-a8b970a73d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cba5ea-8ddd-4283-a2f6-a7e84a3dd740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cba5ea-8ddd-4283-a2f6-a7e84a3dd740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50abbbc-f63c-4e76-8191-ad6cd6da9992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50abbbc-f63c-4e76-8191-ad6cd6da9992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf2d4ba-8399-459c-905a-a8b970a73d90', 'volume_name': 'volume-5bf2d4ba-8399-459c-905a-a8b970a73d90', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b07664b-89d8-43ee-825a-46b1ca18581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b07664b-89d8-43ee-825a-46b1ca18581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef31fb8c-a61f-4f93-a9a9-8ab282e75a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Volume 5bf2d4ba-8399-459c-905a-a8b970a73d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf2d4ba-8399-459c-905a-a8b970a73d90', 'volume_size': 1} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:45 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb" returned: 0 in 0.282s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070508016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f20d3e5-f6e2-4ace-a17b-519d0b234b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:45Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Creating volume 0f20d3e5-f6e2-4ace-a17b-519d0b234b63 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008f6501-fc72-4e4e-86b0-36c4723420d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c87407-d40b-476b-bec7-5eadf67c01bb', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be87c3e2-502d-4e3a-81b9-90982f5ff069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:45 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 1073741824 Jul 22 02:07:45 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Volume volume-31c87407-d40b-476b-bec7-5eadf67c01bb (31c87407-d40b-476b-bec7-5eadf67c01bb): created successfully Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be87c3e2-502d-4e3a-81b9-90982f5ff069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (d5b0f918-7c3d-4078-b5d4-9a5a027fdcd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d224850f-400f-45ed-9d73-41dd8980d223 tempest-CreateVolumesFromImageTest-1554312715 None] Created volume successfully. Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (f52a7c02-be7f-4474-8fe9-c233c6955682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6d531b-a08b-4775-93fc-5665c6852afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6d531b-a08b-4775-93fc-5665c6852afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811526397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f280aa1-8756-4253-aaac-5d2d5c0f1783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f8cf27-553a-4e06-b83a-e36b38ba7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f8cf27-553a-4e06-b83a-e36b38ba7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05aebec-0403-48ff-ad1f-f0076a04d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05aebec-0403-48ff-ad1f-f0076a04d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f280aa1-8756-4253-aaac-5d2d5c0f1783', 'volume_name': 'volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027adb8c-c4f2-41aa-a4c5-d64c5d9bdba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027adb8c-c4f2-41aa-a4c5-d64c5d9bdba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b6c43e-daf3-4356-9885-51fe3db83b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Volume 1f280aa1-8756-4253-aaac-5d2d5c0f1783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783', 'volume_size': 1} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:46 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 1073741824" returned: 0 in 0.482s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (a770ae8a-5b23-402b-b796-8efec8d24668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb29ffc-bad9-457f-92f2-d4a2ad67a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb29ffc-bad9-457f-92f2-d4a2ad67a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-970673801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7856eca0-87c9-4079-9847-a17475af6fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 Jul 22 02:07:46 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948aa995-d25d-4705-a252-015d5691edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948aa995-d25d-4705-a252-015d5691edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfc32ca-04c6-4e84-ad6c-98c63ac2e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfc32ca-04c6-4e84-ad6c-98c63ac2e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7856eca0-87c9-4079-9847-a17475af6fe3', 'volume_name': 'volume-7856eca0-87c9-4079-9847-a17475af6fe3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a624681-bae9-47b6-9344-4154b5661caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a624681-bae9-47b6-9344-4154b5661caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ca32af-d4af-44ac-8688-b392eea13c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Volume 7856eca0-87c9-4079-9847-a17475af6fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7856eca0-87c9-4079-9847-a17475af6fe3', 'volume_size': 1} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:46 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204879499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2d4ba-8399-459c-905a-a8b970a73d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Creating volume 5bf2d4ba-8399-459c-905a-a8b970a73d90 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:46 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b31ae3a-be12-44b8-9f61-4eb1831190dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 1073741824 Jul 22 02:07:46 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8028aa6-a683-4f92-b4a8-cb5e93735311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Volume volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 (0f20d3e5-f6e2-4ace-a17b-519d0b234b63): created successfully Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8028aa6-a683-4f92-b4a8-cb5e93735311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (4f92a437-df23-4624-8831-bdd3f0704f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:46 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-95a81ec8-d3e7-4d3a-8289-e73fe23b5b61 tempest-CreateVolumesFromImageTest-1554312715 None] Created volume successfully. Jul 22 02:07:47 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 1073741824" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:47 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 Jul 22 02:07:47 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:47 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-811526397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f280aa1-8756-4253-aaac-5d2d5c0f1783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Creating volume 1f280aa1-8756-4253-aaac-5d2d5c0f1783 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:47 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef31fb8c-a61f-4f93-a9a9-8ab282e75a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf2d4ba-8399-459c-905a-a8b970a73d90', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62b77c0-f379-4182-8f99-a982c55b2f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:47 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 1073741824 Jul 22 02:07:47 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Volume volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 (5bf2d4ba-8399-459c-905a-a8b970a73d90): created successfully Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62b77c0-f379-4182-8f99-a982c55b2f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (aaff0ab2-7e09-40a5-a8f3-48d7bbad7258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b110d15f-09b0-4a19-a1fd-84b8fb9f112a tempest-CreateVolumesFromImageTest-1554312715 None] Created volume successfully. Jul 22 02:07:47 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 1073741824" returned: 0 in 0.424s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:47 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 Jul 22 02:07:47 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:48 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-970673801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7856eca0-87c9-4079-9847-a17475af6fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e3fa980ed26455c9106df0796dcd3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:46Z,use_quota=True,user_id='52475850a0704634ba39371bb209feda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Creating volume 7856eca0-87c9-4079-9847-a17475af6fe3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b6c43e-daf3-4356-9885-51fe3db83b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:48 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 1073741824 Jul 22 02:07:48 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b44130a-a6db-4224-876a-fae75a14df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Volume volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 (1f280aa1-8756-4253-aaac-5d2d5c0f1783): created successfully Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b44130a-a6db-4224-876a-fae75a14df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (f52a7c02-be7f-4474-8fe9-c233c6955682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ddcbbfdd-7b0f-4cae-a5e5-ee2a74895937 tempest-CreateVolumesFromImageTest-1554312715 None] Created volume successfully. Jul 22 02:07:48 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 1073741824" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:48 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 Jul 22 02:07:48 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:48 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3" returned: 0 in 0.244s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ca32af-d4af-44ac-8688-b392eea13c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7856eca0-87c9-4079-9847-a17475af6fe3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9218d1c0-51e0-408a-8043-84be3263ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Volume volume-7856eca0-87c9-4079-9847-a17475af6fe3 (7856eca0-87c9-4079-9847-a17475af6fe3): created successfully Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9218d1c0-51e0-408a-8043-84be3263ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Flow 'volume_create_manager' (a770ae8a-5b23-402b-b796-8efec8d24668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5554e89d-2bc2-49ce-aa5e-b0e8b9821ea4 tempest-CreateVolumesFromImageTest-1554312715 None] Created volume successfully. Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-7856eca0-87c9-4079-9847-a17475af6fe3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-7856eca0-87c9-4079-9847-a17475af6fe3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-quobyte-7856eca0-87c9-4079-9847-a17475af6fe3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-7856eca0-87c9-4079-9847-a17475af6fe3" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb574e31-6b51-4649-beec-228bafee6f9d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:49 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 Jul 22 02:07:49 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:50 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:50 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3 Jul 22 02:07:50 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:50 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7856eca0-87c9-4079-9847-a17475af6fe3" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-7856eca0-87c9-4079-9847-a17475af6fe3" released by "delete_volume" :: held 0.631s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Created reservations ['74e6caf5-78dd-4898-9549-988148a638b3', 'ffaecf0e-c900-427c-9057-d419adcb52a8', '8ccc2ac1-e326-4ee8-aa13-7587ae8aa0a1', 'd57ed692-884d-435c-8ee6-72c877e9f52e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:50 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:50 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:50 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:50 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Deleted volume successfully. Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d83a6cce-a89e-449e-be99-383ebffdae36 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-7856eca0-87c9-4079-9847-a17475af6fe3-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-1f280aa1-8756-4253-aaac-5d2d5c0f1783-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-1f280aa1-8756-4253-aaac-5d2d5c0f1783-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-quobyte-1f280aa1-8756-4253-aaac-5d2d5c0f1783" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-1f280aa1-8756-4253-aaac-5d2d5c0f1783" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c9bfa-e028-4d2d-a085-5b9a83ff9763]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:51 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 Jul 22 02:07:51 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:51 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783" returned: 0 in 0.355s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:51 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783 Jul 22 02:07:51 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:51 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1f280aa1-8756-4253-aaac-5d2d5c0f1783" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-1f280aa1-8756-4253-aaac-5d2d5c0f1783" released by "delete_volume" :: held 0.644s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Created reservations ['3b16c096-7eee-4b40-81d6-3b2d2388ab73', '466d4781-e9c8-431c-83df-2d4e34c99fb0', '4e85bf5d-0cc2-4d74-b801-750ae0fd75d0', 'e4d6361e-134f-4444-85bd-bb93077313d9'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:51 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:51 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:51 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.238s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Deleted volume successfully. Jul 22 02:07:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-6c1c6a33-c00d-4170-acb8-95c4996da263 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-1f280aa1-8756-4253-aaac-5d2d5c0f1783-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-5bf2d4ba-8399-459c-905a-a8b970a73d90-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-5bf2d4ba-8399-459c-905a-a8b970a73d90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-quobyte-5bf2d4ba-8399-459c-905a-a8b970a73d90" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-5bf2d4ba-8399-459c-905a-a8b970a73d90" acquired by "delete_volume" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6565a95-3bbb-4271-b38a-b30dfd542dce]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:52 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 Jul 22 02:07:52 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:52 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:52 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:52 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:52 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90 Jul 22 02:07:52 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:52 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:07:52 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-5bf2d4ba-8399-459c-905a-a8b970a73d90" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-5bf2d4ba-8399-459c-905a-a8b970a73d90" released by "delete_volume" :: held 0.643s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Created reservations ['846ff100-7d73-4a28-aa69-ea6524c06bf6', 'dbaa5f6f-19f3-4e21-acc0-e45387f2212e', '50002f21-647c-436b-b0af-3e2d7e1a33f3', '23ccbc83-3f41-4c48-b183-2400686db7e1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:52 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:52 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:53 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:53 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Deleted volume successfully. Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-cb58ec2c-0f5c-422b-bc25-9a74116c6310 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-5bf2d4ba-8399-459c-905a-a8b970a73d90-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-0f20d3e5-f6e2-4ace-a17b-519d0b234b63-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-0f20d3e5-f6e2-4ace-a17b-519d0b234b63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-quobyte-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce1fd26-dab9-482f-8c5a-e01ed6b6e8ea]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:53 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 Jul 22 02:07:53 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:53 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:53 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63 Jul 22 02:07:53 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:53 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" returned: 0 in 0.239s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-0f20d3e5-f6e2-4ace-a17b-519d0b234b63" released by "delete_volume" :: held 0.643s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:53 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Created reservations ['a77c09ea-8fa6-453c-9101-211946eba1f0', '1f1fc672-7f6b-422a-a36f-510f4572f304', 'a9334e5b-d78e-4cc4-8513-19bdbc9ce88d', '30091707-15e0-4005-b6dc-6788ed589139'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:54 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:54 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:54 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.261s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Deleted volume successfully. Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-41e8933a-c98c-4d1a-833e-7c16b12a3976 tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-0f20d3e5-f6e2-4ace-a17b-519d0b234b63-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-31c87407-d40b-476b-bec7-5eadf67c01bb-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-31c87407-d40b-476b-bec7-5eadf67c01bb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "cinder-quobyte-31c87407-d40b-476b-bec7-5eadf67c01bb" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-31c87407-d40b-476b-bec7-5eadf67c01bb" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b59eba-e955-44b7-8fd3-c9e311ec93d3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:54 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb Jul 22 02:07:54 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:54 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb" returned: 0 in 0.353s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:54 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb Jul 22 02:07:54 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:55 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-31c87407-d40b-476b-bec7-5eadf67c01bb" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-quobyte-31c87407-d40b-476b-bec7-5eadf67c01bb" released by "delete_volume" :: held 0.635s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Created reservations ['4a0114d7-7c73-4e1b-b5f0-cccbfb9d3777', 'e0ebabc2-1981-4597-af0c-e1964fd09257', '192caa45-99f8-40f0-b73b-6ea960a58177', 'dfe7aee0-ac69-4127-a054-6837c70baa28'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:55 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:07:55 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:55 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:07:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Deleted volume successfully. Jul 22 02:07:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-017d3c1a-1712-4c0b-83a3-a57cb0c82dda tempest-CreateVolumesFromImageTest-1554312715 None] Lock "cinder-31c87407-d40b-476b-bec7-5eadf67c01bb-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Flow 'volume_create_manager' (23ce980d-7d67-4f4e-b030-5160f3e342b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f077f4-7075-48ac-bebd-b14354d04adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f077f4-7075-48ac-bebd-b14354d04adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1758289014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894d49bf-3174-42b1-836d-02705827aed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f15189a4e244eb0af480febf7814ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:58Z,use_quota=True,user_id='53557b9222b542429744272dc5523073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e26e77-ff68-496f-b461-8b406a610581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e26e77-ff68-496f-b461-8b406a610581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71801b65-87cb-42b1-be81-dce37971d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71801b65-87cb-42b1-be81-dce37971d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894d49bf-3174-42b1-836d-02705827aed8', 'volume_name': 'volume-894d49bf-3174-42b1-836d-02705827aed8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3fc1ca-028a-4a7c-a944-2b088004e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3fc1ca-028a-4a7c-a944-2b088004e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c7958b-6592-479e-84f3-41d7e9391092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Volume 894d49bf-3174-42b1-836d-02705827aed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894d49bf-3174-42b1-836d-02705827aed8', 'volume_size': 1} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1758289014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894d49bf-3174-42b1-836d-02705827aed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f15189a4e244eb0af480febf7814ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:07:58Z,use_quota=True,user_id='53557b9222b542429744272dc5523073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Creating volume 894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:07:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:58 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 1073741824 Jul 22 02:07:58 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:58 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 1073741824" returned: 0 in 0.431s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:58 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:07:58 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:58 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c7958b-6592-479e-84f3-41d7e9391092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894d49bf-3174-42b1-836d-02705827aed8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246a8c7-45b2-428b-97e0-56781298d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:07:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Volume volume-894d49bf-3174-42b1-836d-02705827aed8 (894d49bf-3174-42b1-836d-02705827aed8): created successfully Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246a8c7-45b2-428b-97e0-56781298d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:07:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Flow 'volume_create_manager' (23ce980d-7d67-4f4e-b030-5160f3e342b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:07:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-349584f5-8c00-4d49-805f-087fd6c7730e tempest-VolumeDependencyTests-794086851 None] Created volume successfully. Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Creating offline snapshot 030c878a-7751-42d6-bc64-e69c8323b1d2 of volume 894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6c178-83a7-4500-b4b0-b5348d51eba3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:59 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:07:59 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:07:59 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.340s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:07:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:07:59 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 1G Jul 22 02:07:59 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:00 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 1G" returned: 0 in 0.391s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894d49bf-3174-42b1-836d-02705827aed8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:00 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894d49bf-3174-42b1-836d-02705827aed8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:00 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:00 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894d49bf-3174-42b1-836d-02705827aed8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 is being set with open permissions: ugo+rw Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:00 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:00 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:00 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:00 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info Jul 22 02:08:00 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:00 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:00 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info is being set with open permissions: ugo+rw Jul 22 02:08:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:00 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info Jul 22 02:08:00 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:01 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.info" returned: 0 in 0.248s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:01 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4386dab5-53f2-45b6-9b73-4193bdedefc2 tempest-VolumeDependencyTests-794086851 None] Create snapshot completed successfully Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Flow 'volume_create_manager' (14b818e2-431a-4435-ac2c-0181709e9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd899a-a0b6-4602-89bf-9dba37ed43b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cd899a-a0b6-4602-89bf-9dba37ed43b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2141362746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8369160-3b8e-4e7a-973e-e149bf6d189a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f15189a4e244eb0af480febf7814ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=030c878a-7751-42d6-bc64-e69c8323b1d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:02Z,use_quota=True,user_id='53557b9222b542429744272dc5523073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c38b29-fb99-49c8-bf12-1b59b67e9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c38b29-fb99-49c8-bf12-1b59b67e9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08e84de-bee6-4712-9bab-963fc2b5c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08e84de-bee6-4712-9bab-963fc2b5c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8369160-3b8e-4e7a-973e-e149bf6d189a', 'volume_name': 'volume-c8369160-3b8e-4e7a-973e-e149bf6d189a', 'volume_size': 1, 'snapshot_id': '030c878a-7751-42d6-bc64-e69c8323b1d2'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fafb3b-9a26-4de3-9677-7b22cae19066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4fafb3b-9a26-4de3-9677-7b22cae19066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b8240f-fb6c-429b-a865-271ab2e9f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Volume c8369160-3b8e-4e7a-973e-e149bf6d189a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8369160-3b8e-4e7a-973e-e149bf6d189a', 'volume_size': 1, 'snapshot_id': '030c878a-7751-42d6-bc64-e69c8323b1d2'} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2-c8369160-3b8e-4e7a-973e-e149bf6d189a" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2-c8369160-3b8e-4e7a-973e-e149bf6d189a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Creating volume c8369160-3b8e-4e7a-973e-e149bf6d189a from snapshot 030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] snapshot: 030c878a-7751-42d6-bc64-e69c8323b1d2, volume: c8369160-3b8e-4e7a-973e-e149bf6d189a, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5d3ad-1c0c-44a1-915d-b29cfd748df4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:02 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:02 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:02 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-894d49bf-3174-42b1-836d-02705827aed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14a11d-148a-4b52-b6d0-8546b508b900]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:02 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:08:02 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:02 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.360s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:08:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:02 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a Jul 22 02:08:02 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:06 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a" returned: 0 in 4.102s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7152bff6-58a2-46de-af58-f8fa15135889]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:07 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:08:07 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:07 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.538s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:08:07 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Converted 1024.00 MB image at 249.58 MB/s Jul 22 02:08:07 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a is being set with open permissions: ugo+rw Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:07 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a Jul 22 02:08:07 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:07 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" released by "_copy_volume_from_snapshot" :: held 5.680s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2-c8369160-3b8e-4e7a-973e-e149bf6d189a" released by "_create_volume_from_snapshot" :: held 5.711s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.727s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b8240f-fb6c-429b-a865-271ab2e9f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8369160-3b8e-4e7a-973e-e149bf6d189a', 'volume_size': 1, 'snapshot_id': '030c878a-7751-42d6-bc64-e69c8323b1d2'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e94a1ec-1d7d-40d3-854c-a0bb130635fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Volume volume-c8369160-3b8e-4e7a-973e-e149bf6d189a (c8369160-3b8e-4e7a-973e-e149bf6d189a): created successfully Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e94a1ec-1d7d-40d3-854c-a0bb130635fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Flow 'volume_create_manager' (14b818e2-431a-4435-ac2c-0181709e9eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2e41a758-7ba5-4fdf-9cb2-baa6b669f32e tempest-VolumeDependencyTests-794086851 None] Created volume successfully. Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-030c878a-7751-42d6-bc64-e69c8323b1d2-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-030c878a-7751-42d6-bc64-e69c8323b1d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Deleting offline snapshot 030c878a-7751-42d6-bc64-e69c8323b1d2 of volume 894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] snapshot_file for this snap is: volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ab64d-4e14-4416-9580-e0f1621d8fbb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:08 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:08 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:08 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.346s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-894d49bf-3174-42b1-836d-02705827aed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557a91d-4f87-4bf2-8e6c-7f4f14177229]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:08 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:08:08 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:09 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.339s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:09 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:09 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:09 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.336s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:09 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2 Jul 22 02:08:09 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:09 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8.030c878a-7751-42d6-bc64-e69c8323b1d2" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-030c878a-7751-42d6-bc64-e69c8323b1d2" released by "_delete_snapshot" :: held 1.358s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" released by "delete_snapshot" :: held 1.379s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Created reservations ['ca3f5810-f41c-4570-9b9c-53068d6f18f7', '5174bc7f-806b-4e25-8b54-921536ffd458', 'ace712c6-84f4-4329-8cf8-003ed5d8deea', '4807f6ac-1b09-425a-8ab4-14ebb90ce16f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Delete snapshot completed successfully. Jul 22 02:08:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-973fc468-8ebf-44c7-b429-6fa665d8d8f7 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-030c878a-7751-42d6-bc64-e69c8323b1d2-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-894d49bf-3174-42b1-836d-02705827aed8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "cinder-894d49bf-3174-42b1-836d-02705827aed8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" acquired by "delete_volume" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f306d-cd64-477a-9787-8cc9ebc9c911]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:10 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:08:10 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:11 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:11 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8 Jul 22 02:08:11 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:11 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-894d49bf-3174-42b1-836d-02705827aed8" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-894d49bf-3174-42b1-836d-02705827aed8" released by "delete_volume" :: held 0.654s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Created reservations ['2dc038f8-2b81-4f8e-aa96-b84f8b253163', '488a4174-2f05-4daf-a399-27c30d2b5751', '7053dc6e-cd50-40d7-8dec-9693c9c4490f', '5a45d13b-02e8-47ee-b55d-3538cd43afdf'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:11 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:11 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:11 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Deleted volume successfully. Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-0da94849-b06b-4aec-a272-1ed610112efe tempest-VolumeDependencyTests-794086851 None] Lock "cinder-894d49bf-3174-42b1-836d-02705827aed8-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-c8369160-3b8e-4e7a-973e-e149bf6d189a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-c8369160-3b8e-4e7a-973e-e149bf6d189a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6f7587-d339-4bac-a238-648c0174f227]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:11 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a Jul 22 02:08:11 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:12 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:12 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a Jul 22 02:08:12 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:12 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c8369160-3b8e-4e7a-973e-e149bf6d189a" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-quobyte-c8369160-3b8e-4e7a-973e-e149bf6d189a" released by "delete_volume" :: held 0.630s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Created reservations ['68bd096e-9e1c-4297-b30f-1c71f737994b', '92491f47-1f69-40f6-980b-5c66232a135a', '1de32e8f-a937-465b-82e4-5646d77b163f', '6b6fc2df-878a-4366-ad27-384286606de5'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:12 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:12 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:12 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.239s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Deleted volume successfully. Jul 22 02:08:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b33f2100-11d5-4b9d-9042-d813a8de31b0 tempest-VolumeDependencyTests-794086851 None] Lock "cinder-c8369160-3b8e-4e7a-973e-e149bf6d189a-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Flow 'volume_create_manager' (32ee7fac-aa5e-4b54-ba9a-9faac6392fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394ab1bd-f1ce-49b1-afab-e7be62f77050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394ab1bd-f1ce-49b1-afab-e7be62f77050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567844849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4f9cf8-b761-4cd0-8eda-ec874a63a39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e74182ef0b4ee9926ce6bc6bf6889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:16Z,use_quota=True,user_id='f413ebf4d0154a85abb19ca1ec2e038a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4837cec-8d9d-4324-a9c6-85034999fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4837cec-8d9d-4324-a9c6-85034999fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3806076a-c4d0-4cf8-b0e7-0d6daa4a89d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3806076a-c4d0-4cf8-b0e7-0d6daa4a89d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4f9cf8-b761-4cd0-8eda-ec874a63a39a', 'volume_name': 'volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f8280-19a3-4de4-bd0d-692003abd2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72f8280-19a3-4de4-bd0d-692003abd2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9da379e-148c-4823-8fd7-8b7b2a4ae2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Volume ac4f9cf8-b761-4cd0-8eda-ec874a63a39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a', 'volume_size': 1} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567844849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4f9cf8-b761-4cd0-8eda-ec874a63a39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e74182ef0b4ee9926ce6bc6bf6889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:16Z,use_quota=True,user_id='f413ebf4d0154a85abb19ca1ec2e038a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Creating volume ac4f9cf8-b761-4cd0-8eda-ec874a63a39a {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:16 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:16 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a 1073741824 Jul 22 02:08:16 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:16 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a 1073741824" returned: 0 in 0.413s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:16 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a Jul 22 02:08:16 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:16 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" returned: 0 in 0.237s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9da379e-148c-4823-8fd7-8b7b2a4ae2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18303f7-d63c-4a14-8286-b48916910071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Volume volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a (ac4f9cf8-b761-4cd0-8eda-ec874a63a39a): created successfully Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18303f7-d63c-4a14-8286-b48916910071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Flow 'volume_create_manager' (32ee7fac-aa5e-4b54-ba9a-9faac6392fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-eff96ac1-19c1-4874-b559-861ec344938a tempest-ProjectReaderTests-1662301221 None] Created volume successfully. Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Acquiring lock "cinder-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "cinder-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Acquiring lock "cinder-quobyte-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "cinder-quobyte-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4f3d01-a691-4a67-bc41-57a4c8a43060]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:17 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a Jul 22 02:08:17 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:17 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:17 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a Jul 22 02:08:17 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:17 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "cinder-quobyte-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a" released by "delete_volume" :: held 0.673s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Created reservations ['29f2f457-1ce4-4839-9c86-dce0ab294c85', 'f5ada6ed-9f6c-4ca6-8714-bba7ae3d692e', '010b1e06-6850-4ea2-b248-e769f8b6b50e', '0bf03643-6e40-4b59-97ea-47e7ff5660ae'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:18 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:18 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:18 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Deleted volume successfully. Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-21c739d7-21da-40b2-b6ff-4fbc599006a6 tempest-ProjectReaderTests-1662301221 None] Lock "cinder-ac4f9cf8-b761-4cd0-8eda-ec874a63a39a-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Flow 'volume_create_manager' (c2ec5440-90a3-4a23-955d-2ed785cc8047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea33c37-a918-4c58-bbec-491f7fef477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea33c37-a918-4c58-bbec-491f7fef477d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496333175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931eed19-1582-4179-aaf6-3d1888fd6740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e74182ef0b4ee9926ce6bc6bf6889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:19Z,use_quota=True,user_id='f413ebf4d0154a85abb19ca1ec2e038a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ec87b7-66ed-4d76-b64a-183b13a42e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ec87b7-66ed-4d76-b64a-183b13a42e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5558f81-e8f7-455a-bfcd-39df67e99266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5558f81-e8f7-455a-bfcd-39df67e99266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931eed19-1582-4179-aaf6-3d1888fd6740', 'volume_name': 'volume-931eed19-1582-4179-aaf6-3d1888fd6740', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f9b1fd-c0a2-4cb0-a6a3-6332d161f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f9b1fd-c0a2-4cb0-a6a3-6332d161f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4e858a-9a70-48ed-97f0-19052ed227c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Volume 931eed19-1582-4179-aaf6-3d1888fd6740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931eed19-1582-4179-aaf6-3d1888fd6740', 'volume_size': 1} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496333175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931eed19-1582-4179-aaf6-3d1888fd6740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e74182ef0b4ee9926ce6bc6bf6889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:19Z,use_quota=True,user_id='f413ebf4d0154a85abb19ca1ec2e038a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Creating volume 931eed19-1582-4179-aaf6-3d1888fd6740 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:19 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 1073741824 Jul 22 02:08:19 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:19 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 1073741824" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:19 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 Jul 22 02:08:19 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:19 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740" returned: 0 in 0.236s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4e858a-9a70-48ed-97f0-19052ed227c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931eed19-1582-4179-aaf6-3d1888fd6740', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be198c5-b681-4470-b2d2-5629abb24a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Volume volume-931eed19-1582-4179-aaf6-3d1888fd6740 (931eed19-1582-4179-aaf6-3d1888fd6740): created successfully Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be198c5-b681-4470-b2d2-5629abb24a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Flow 'volume_create_manager' (c2ec5440-90a3-4a23-955d-2ed785cc8047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4c866d98-ef36-40cc-bb8e-68f573d16309 tempest-ProjectReaderTests-1662301221 None] Created volume successfully. Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Acquiring lock "cinder-931eed19-1582-4179-aaf6-3d1888fd6740-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "cinder-931eed19-1582-4179-aaf6-3d1888fd6740-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Acquiring lock "cinder-quobyte-931eed19-1582-4179-aaf6-3d1888fd6740" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "cinder-quobyte-931eed19-1582-4179-aaf6-3d1888fd6740" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ad0ac-2030-461d-9296-b70475cd9e7b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:20 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 Jul 22 02:08:20 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:20 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740" returned: 0 in 0.367s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:20 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740 Jul 22 02:08:20 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:20 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-931eed19-1582-4179-aaf6-3d1888fd6740" returned: 0 in 0.244s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "cinder-quobyte-931eed19-1582-4179-aaf6-3d1888fd6740" released by "delete_volume" :: held 0.652s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Created reservations ['640e42dd-62fc-4211-a430-eb187c2c0d49', '46356152-3793-4424-9000-bf145a88a03e', '8b8baca5-94da-4e77-8d21-21d19251f51d', '975514b6-d1c2-4b8a-a8d3-8b760645f0a1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:20 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:20 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:21 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.262s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:21 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:21 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Deleted volume successfully. Jul 22 02:08:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16ed7710-7c92-43e9-a846-90f00b266f5d tempest-ProjectReaderTests-1662301221 None] Lock "cinder-931eed19-1582-4179-aaf6-3d1888fd6740-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (72783447-51cb-471b-895c-96997933b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f3c0d1-606b-4c5b-be06-8490533b4f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f3c0d1-606b-4c5b-be06-8490533b4f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694078239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34b805-02ef-4fcc-bbd8-c647942fd0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:25Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a4b7f7-7f2d-4c72-80da-ffa1580ab71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a4b7f7-7f2d-4c72-80da-ffa1580ab71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81ce6ff-55ff-41b5-bf5e-654d0773b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81ce6ff-55ff-41b5-bf5e-654d0773b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b34b805-02ef-4fcc-bbd8-c647942fd0c3', 'volume_name': 'volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62445c1e-e8ab-49e9-b355-405af2f7e7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62445c1e-e8ab-49e9-b355-405af2f7e7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2577f52-fdf1-4534-b72a-939664b84608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:24 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Volume 1b34b805-02ef-4fcc-bbd8-c647942fd0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3', 'volume_size': 1} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1694078239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34b805-02ef-4fcc-bbd8-c647942fd0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:25Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Creating volume 1b34b805-02ef-4fcc-bbd8-c647942fd0c3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:24 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:24 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 1073741824 Jul 22 02:08:24 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:25 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 1073741824" returned: 0 in 0.416s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:25 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 Jul 22 02:08:25 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:25 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2577f52-fdf1-4534-b72a-939664b84608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd28365-3c2e-4c87-a255-54f0b3a8432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Volume volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 (1b34b805-02ef-4fcc-bbd8-c647942fd0c3): created successfully Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd28365-3c2e-4c87-a255-54f0b3a8432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (72783447-51cb-471b-895c-96997933b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6ffdbe84-01d8-4db9-b12f-2ede892edaa0 tempest-ProjectReaderTests-2132713948 None] Created volume successfully. Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-1b34b805-02ef-4fcc-bbd8-c647942fd0c3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "cinder-1b34b805-02ef-4fcc-bbd8-c647942fd0c3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-quobyte-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" acquired by "delete_volume" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f093071c-76b5-4d3b-aff8-0631fe00ddf3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:25 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 Jul 22 02:08:25 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:26 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:26 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3 Jul 22 02:08:26 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:26 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" returned: 0 in 0.240s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-1b34b805-02ef-4fcc-bbd8-c647942fd0c3" released by "delete_volume" :: held 0.649s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Created reservations ['81b67e1c-8918-4bcb-8ea1-505bdb851fa0', 'f3a8fac2-c42f-4dcf-ada7-e4258d32b219', '7be17a67-b2c5-4fc7-8f9d-ae1d1c3fe60a', 'd377822b-8666-45cd-b514-706038c37b08'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:26 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:26 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:26 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.238s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Deleted volume successfully. Jul 22 02:08:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-84915562-0575-4cdd-955a-0afc63dd6dcf tempest-ProjectReaderTests-2132713948 None] Lock "cinder-1b34b805-02ef-4fcc-bbd8-c647942fd0c3-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (678935e0-6aa6-42ef-8c46-5cc278bc8e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369081a2-a2b0-4556-87e1-566d69e97252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369081a2-a2b0-4556-87e1-566d69e97252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534432517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023385b0-fe0f-43b1-b069-987236a08361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:27Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dd0510-5a4e-4f31-95d2-a88f3aadedb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dd0510-5a4e-4f31-95d2-a88f3aadedb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5177a615-9928-4bcb-a59b-0f00d9c9d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5177a615-9928-4bcb-a59b-0f00d9c9d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023385b0-fe0f-43b1-b069-987236a08361', 'volume_name': 'volume-023385b0-fe0f-43b1-b069-987236a08361', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014df9f2-b209-4958-a533-ef76ecbbf0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014df9f2-b209-4958-a533-ef76ecbbf0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bef2bad-5994-4df3-954d-3b05b030d3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Volume 023385b0-fe0f-43b1-b069-987236a08361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023385b0-fe0f-43b1-b069-987236a08361', 'volume_size': 1} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534432517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023385b0-fe0f-43b1-b069-987236a08361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:27Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Creating volume 023385b0-fe0f-43b1-b069-987236a08361 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:27 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:27 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 1073741824 Jul 22 02:08:27 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:27 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 1073741824" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:27 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 Jul 22 02:08:27 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:28 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361" returned: 0 in 0.251s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bef2bad-5994-4df3-954d-3b05b030d3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023385b0-fe0f-43b1-b069-987236a08361', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a58601a-ea9d-4ed2-9efa-d4cb1675be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:28 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Volume volume-023385b0-fe0f-43b1-b069-987236a08361 (023385b0-fe0f-43b1-b069-987236a08361): created successfully Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a58601a-ea9d-4ed2-9efa-d4cb1675be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (678935e0-6aa6-42ef-8c46-5cc278bc8e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a51234c9-3aff-4cd9-8277-987d92ff2cb8 tempest-ProjectReaderTests-2132713948 None] Created volume successfully. Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-023385b0-fe0f-43b1-b069-987236a08361-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "cinder-023385b0-fe0f-43b1-b069-987236a08361-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-quobyte-023385b0-fe0f-43b1-b069-987236a08361" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-023385b0-fe0f-43b1-b069-987236a08361" acquired by "delete_volume" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee80215-4762-4af4-8ecb-b4c66bee6ae3]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:28 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 Jul 22 02:08:28 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:28 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361" returned: 0 in 0.353s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:28 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361 Jul 22 02:08:28 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:29 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-023385b0-fe0f-43b1-b069-987236a08361" returned: 0 in 0.258s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-023385b0-fe0f-43b1-b069-987236a08361" released by "delete_volume" :: held 0.654s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Created reservations ['71b56e60-bdf7-47dc-aac0-3a8118bfb79a', '56a13628-e557-400b-9df7-f5665811a33d', '36720a55-ee40-480e-ab55-dd637860784f', '2fea5009-ae51-40ce-ab17-ee6096d05036'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:29 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:29 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:29 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.251s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Deleted volume successfully. Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-24857a91-8ec1-45d0-9da3-db8981a5f849 tempest-ProjectReaderTests-2132713948 None] Lock "cinder-023385b0-fe0f-43b1-b069-987236a08361-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (420dd0ee-6f12-4564-824f-6926b9e162d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:29 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0515f1cd-5024-40f9-bedf-270207b43bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0515f1cd-5024-40f9-bedf-270207b43bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022809951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631eb8c-f78e-48bb-b6d7-e07783c4236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:30Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee8a410-91d1-486b-bdbd-d92ed365d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee8a410-91d1-486b-bdbd-d92ed365d772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e3afc6-e18d-4946-a824-5f11c21c99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e3afc6-e18d-4946-a824-5f11c21c99c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a631eb8c-f78e-48bb-b6d7-e07783c4236d', 'volume_name': 'volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7b25a8-eeb5-4e91-b2b0-65e12b2fac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7b25a8-eeb5-4e91-b2b0-65e12b2fac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12d0fb9-ec63-4c1e-8d1f-d7c781f30f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Volume a631eb8c-f78e-48bb-b6d7-e07783c4236d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d', 'volume_size': 1} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022809951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631eb8c-f78e-48bb-b6d7-e07783c4236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:30Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Creating volume a631eb8c-f78e-48bb-b6d7-e07783c4236d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:30 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:30 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d 1073741824 Jul 22 02:08:30 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:30 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d 1073741824" returned: 0 in 0.397s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:30 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d Jul 22 02:08:30 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:30 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d" returned: 0 in 0.237s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12d0fb9-ec63-4c1e-8d1f-d7c781f30f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae37eecd-f73d-443a-bf8d-9a010dda0e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=108,cinder:UPDATE=144,cinder:INSERT=34,cinder:DELETE=9 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:08:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Volume volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d (a631eb8c-f78e-48bb-b6d7-e07783c4236d): created successfully Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae37eecd-f73d-443a-bf8d-9a010dda0e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (420dd0ee-6f12-4564-824f-6926b9e162d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:30 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=95,cinder:UPDATE=141,cinder:INSERT=41,cinder:DELETE=16 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:08:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3bf10ec9-b376-4caf-897e-ae7761da0e76 tempest-ProjectReaderTests-2132713948 None] Created volume successfully. Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-a631eb8c-f78e-48bb-b6d7-e07783c4236d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "cinder-a631eb8c-f78e-48bb-b6d7-e07783c4236d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-quobyte-a631eb8c-f78e-48bb-b6d7-e07783c4236d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-a631eb8c-f78e-48bb-b6d7-e07783c4236d" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b41e68-6a6a-4256-99f5-2f640759104e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:31 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d Jul 22 02:08:31 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:31 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d" returned: 0 in 0.351s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:31 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d Jul 22 02:08:31 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:31 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a631eb8c-f78e-48bb-b6d7-e07783c4236d" returned: 0 in 0.239s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-a631eb8c-f78e-48bb-b6d7-e07783c4236d" released by "delete_volume" :: held 0.626s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Created reservations ['94ba819b-0343-4548-a6a0-2862b13f6442', '5df2fbb6-f47a-45a6-832f-193f97143505', 'eb4551e2-fc01-49ca-96bf-e8b661646f61', 'eca413f8-c318-49b8-84f9-db65dd8e5592'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:31 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:31 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:32 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Deleted volume successfully. Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b990574-152c-4f33-8bbf-347e45f3219e tempest-ProjectReaderTests-2132713948 None] Lock "cinder-a631eb8c-f78e-48bb-b6d7-e07783c4236d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (b139d4a7-ab95-46be-86c9-9b2fc581cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522633df-16a0-48e7-9231-bc1bb85cec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522633df-16a0-48e7-9231-bc1bb85cec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082388146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6d626c-00ea-4b62-b493-d97c44b1edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:33Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacda5be-5333-42a1-aee6-c076b2812ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacda5be-5333-42a1-aee6-c076b2812ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bad7d7-7064-4a71-8f54-87ea6ab69ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bad7d7-7064-4a71-8f54-87ea6ab69ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6d626c-00ea-4b62-b493-d97c44b1edf3', 'volume_name': 'volume-de6d626c-00ea-4b62-b493-d97c44b1edf3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543f293-8186-4287-bce4-cd211221ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543f293-8186-4287-bce4-cd211221ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d3506b-6964-4f91-99ef-e7df58986149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:32 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Volume de6d626c-00ea-4b62-b493-d97c44b1edf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6d626c-00ea-4b62-b493-d97c44b1edf3', 'volume_size': 1} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082388146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6d626c-00ea-4b62-b493-d97c44b1edf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c387b9a1b0a5403ea4ef12263f4f18b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:33Z,use_quota=True,user_id='a02d2a6459ad4aaeb48960e5d68a80bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Creating volume de6d626c-00ea-4b62-b493-d97c44b1edf3 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:32 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:32 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 1073741824 Jul 22 02:08:32 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:33 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 1073741824" returned: 0 in 0.420s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:33 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 Jul 22 02:08:33 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:33 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d3506b-6964-4f91-99ef-e7df58986149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6d626c-00ea-4b62-b493-d97c44b1edf3', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064a541-ef13-4cd7-bd62-257c450a0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:33 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Volume volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 (de6d626c-00ea-4b62-b493-d97c44b1edf3): created successfully Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1064a541-ef13-4cd7-bd62-257c450a0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Flow 'volume_create_manager' (b139d4a7-ab95-46be-86c9-9b2fc581cd70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-67e5e105-46bf-4a42-95d2-552f817d8f7a tempest-ProjectReaderTests-2132713948 None] Created volume successfully. Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-de6d626c-00ea-4b62-b493-d97c44b1edf3-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "cinder-de6d626c-00ea-4b62-b493-d97c44b1edf3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Acquiring lock "cinder-quobyte-de6d626c-00ea-4b62-b493-d97c44b1edf3" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-de6d626c-00ea-4b62-b493-d97c44b1edf3" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8691b6fc-8231-4884-80fd-d4aa5babd850]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:33 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 Jul 22 02:08:33 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:34 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3" returned: 0 in 0.355s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:34 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3 Jul 22 02:08:34 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:34 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-de6d626c-00ea-4b62-b493-d97c44b1edf3" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "cinder-quobyte-de6d626c-00ea-4b62-b493-d97c44b1edf3" released by "delete_volume" :: held 0.644s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Created reservations ['bc4ffe02-a1a0-419a-8fd3-9fa093ac4fec', '8ad6b9a1-f407-4a76-a2a6-f6f9aa5829cb', '68525023-2de2-4c8c-8456-44b49c2b390d', 'b7fc6976-52bd-4a3e-914f-2843141799e0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:34 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:34 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:34 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.244s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:34 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Deleted volume successfully. Jul 22 02:08:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-df307d22-11e7-4499-b679-d4ae5cd02d3d tempest-ProjectReaderTests-2132713948 None] Lock "cinder-de6d626c-00ea-4b62-b493-d97c44b1edf3-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:44 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:DELETE=3,cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=21 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:08:44 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=12,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (2c697e1b-d86b-45fd-8a3b-16cd3dee8f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f026ab-0deb-4baf-9d29-d3d6758d69d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f026ab-0deb-4baf-9d29-d3d6758d69d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-37258178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b629b21b-5d85-4d68-9702-e27f42e9657c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:47Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b476b4f-aad6-4799-af12-f4e969eb3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b476b4f-aad6-4799-af12-f4e969eb3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cecf83-1a44-46b3-8e35-42d534f9214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cecf83-1a44-46b3-8e35-42d534f9214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b629b21b-5d85-4d68-9702-e27f42e9657c', 'volume_name': 'volume-b629b21b-5d85-4d68-9702-e27f42e9657c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401efff8-5e06-4f76-aecf-bb57c803e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401efff8-5e06-4f76-aecf-bb57c803e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc55fa64-a818-4dac-9c52-9af61cd04933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume b629b21b-5d85-4d68-9702-e27f42e9657c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b629b21b-5d85-4d68-9702-e27f42e9657c', 'volume_size': 1} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-37258178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b629b21b-5d85-4d68-9702-e27f42e9657c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:47Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:46 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6983a929-e854-4cf6-8538-ca54fa3d0304 tempest-ProjectAdminTests-1169433916 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6981163024902, 'free_capacity_gb': 1775.6981163024902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87153) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 22 02:08:47 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c 1073741824 Jul 22 02:08:47 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:47 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c 1073741824" returned: 0 in 0.531s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:47 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c Jul 22 02:08:47 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:47 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc55fa64-a818-4dac-9c52-9af61cd04933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b629b21b-5d85-4d68-9702-e27f42e9657c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea8f681-be3e-4987-a0a1-87f70c2b5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-b629b21b-5d85-4d68-9702-e27f42e9657c (b629b21b-5d85-4d68-9702-e27f42e9657c): created successfully Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea8f681-be3e-4987-a0a1-87f70c2b5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (2c697e1b-d86b-45fd-8a3b-16cd3dee8f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f6d1c060-2f2b-460a-8e2e-5bd231863a31 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating offline snapshot c56f8349-2ff2-4d71-900b-3c0f89fb184f of volume b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0540c36f-b8b1-48d5-91e1-fac1eb6411bf]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:49 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c Jul 22 02:08:49 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:49 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c" returned: 0 in 0.444s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:49 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f 1G Jul 22 02:08:49 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:50 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f 1G" returned: 0 in 0.503s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b629b21b-5d85-4d68-9702-e27f42e9657c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:50 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b629b21b-5d85-4d68-9702-e27f42e9657c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f Jul 22 02:08:50 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Flow 'volume_create_manager' (d5c1a8a6-650d-4379-8b59-70bfd8fffdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7a9313-c742-463f-8660-76470644ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7a9313-c742-463f-8660-76470644ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcd04c-e4ae-4947-beef-5c1b8363cf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7bb3b05a9143f09ec98dc03c3cceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:51Z,use_quota=True,user_id='d6f72e21ec974c529ba42f4a3813aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75db026d-eba7-4b46-bd98-448b4a3b45cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:50 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75db026d-eba7-4b46-bd98-448b4a3b45cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58639c4e-a1f8-485c-8795-341343999150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b629b21b-5d85-4d68-9702-e27f42e9657c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f" returned: 0 in 0.403s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f is being set with open permissions: ugo+rw Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:50 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f Jul 22 02:08:50 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:50 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:51 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info Jul 22 02:08:51 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58639c4e-a1f8-485c-8795-341343999150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08dcd04c-e4ae-4947-beef-5c1b8363cf25', 'volume_name': 'volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25', 'volume_size': 1, 'image_id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98309db49f4e076ba4bade0e5c11f082', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd7bb3b05a9143f09ec98dc03c3cceae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2606256024848f9a541927da6b2978aa70fd1ff63a1ce6b99d7809c00358e626e902ac6319e5e7fb1b9e6fde1ddea463dbe3ae850b8898ed48770df7c0b82ba5', 'id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48a49dd6-b39e-43b2-9c94-ae293f830626/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301260ce-c686-40c2-ab51-a2e6c97dadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301260ce-c686-40c2-ab51-a2e6c97dadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c801a92-4f0c-4f91-824f-e82c3325c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25', 'volume_size': 1, 'image_id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98309db49f4e076ba4bade0e5c11f082', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd7bb3b05a9143f09ec98dc03c3cceae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2606256024848f9a541927da6b2978aa70fd1ff63a1ce6b99d7809c00358e626e902ac6319e5e7fb1b9e6fde1ddea463dbe3ae850b8898ed48770df7c0b82ba5', 'id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48a49dd6-b39e-43b2-9c94-ae293f830626/file', 'properties': {}}, 'image_service': } Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Trying to clone 08dcd04c-e4ae-4947-beef-5c1b8363cf25 from image 48a49dd6-b39e-43b2-9c94-ae293f830626 at location (None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:08:51 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Image download 0.00 MB at 0.00 MB/s Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Flow 'volume_create_manager' (9be25f8e-22ab-4907-ae0c-b0bff6f496b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:51 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea1882-22fe-4813-a04a-01f961978584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba3a7b-cfd8-486b-8840-1601fbfc66db]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:51 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info is being set with open permissions: ugo+rw Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:51 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info Jul 22 02:08:51 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea1882-22fe-4813-a04a-01f961978584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd6953a-f000-46e7-af74-9d5131df1b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268512deedb543b1b31f0f09d8548189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:51Z,use_quota=True,user_id='5d9351db28af4f39adf759a2f17e7743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10218c10-6cee-4a6f-925a-af448075cd3b),volume_type_id=10218c10-6cee-4a6f-925a-af448075cd3b)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94adf6b-af62-44d6-8a1e-12fb9cbf083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94adf6b-af62-44d6-8a1e-12fb9cbf083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900a82e1-d1af-46d3-9b65-e59a2b7704f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.image.glance [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Creating Keystone auth plugin from conf {{(pid=87153) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 22 02:08:51 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:51 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:51 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.info" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-774a8440-8a8f-4cce-92bd-3c024ed0cd2f tempest-CreateVolumesFromSnapshotTest-2036959676 None] Create snapshot completed successfully Jul 22 02:08:51 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900a82e1-d1af-46d3-9b65-e59a2b7704f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cd6953a-f000-46e7-af74-9d5131df1b72', 'volume_name': 'volume-1cd6953a-f000-46e7-af74-9d5131df1b72', 'volume_size': 1, 'image_id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd7d20657e2be4868ee0488baab47947', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268512deedb543b1b31f0f09d8548189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd41a502b8a455250d224700bc8feb79701dd1bf82bc4b84044e0f22a8e67864f54cf1c2c2dfcdc0dd148614a1b41a51ad5a43f5745f0bc242ffbe9eaaca245cc', 'id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab17571-09b9-43dd-a572-3afebd7d5171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab17571-09b9-43dd-a572-3afebd7d5171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d907a97-149d-4a25-b13f-5a6ab9b57968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Volume 1cd6953a-f000-46e7-af74-9d5131df1b72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cd6953a-f000-46e7-af74-9d5131df1b72', 'volume_size': 1, 'image_id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd7d20657e2be4868ee0488baab47947', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268512deedb543b1b31f0f09d8548189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd41a502b8a455250d224700bc8feb79701dd1bf82bc4b84044e0f22a8e67864f54cf1c2c2dfcdc0dd148614a1b41a51ad5a43f5745f0bc242ffbe9eaaca245cc', 'id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 22 02:08:51 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Trying to clone 1cd6953a-f000-46e7-af74-9d5131df1b72 from image 73342b22-9257-4bf3-8f20-f43c4f6afd4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}]). {{(pid=87153) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 22 02:08:51 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:51 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 22 02:08:52 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Image download 0.00 MB at 0.00 MB/s Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2263946c-ae3c-4ca7-a767-aeff2e5fb2ba]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:52 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Temporary image 48a49dd6-b39e-43b2-9c94-ae293f830626 is fetched for user d6f72e21ec974c529ba42f4a3813aa53. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:08:52 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:52 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9046e2-aeb5-4a48-8f62-6cd7c96d8908]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:52 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:52 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:52 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:52 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:52 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:52 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:52 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:52 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.328s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:08:52 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:52 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Temporary image 73342b22-9257-4bf3-8f20-f43c4f6afd4b is fetched for user 5d9351db28af4f39adf759a2f17e7743. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 22 02:08:53 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (4e5292d0-cdcb-4cf1-83f8-065f80989df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1a7973-8dd7-4c7f-a3fb-9bacc37e6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcd04c-e4ae-4947-beef-5c1b8363cf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7bb3b05a9143f09ec98dc03c3cceae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:51Z,use_quota=True,user_id='d6f72e21ec974c529ba42f4a3813aa53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Creating volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:53 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:53 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1073741824 Jul 22 02:08:53 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1a7973-8dd7-4c7f-a3fb-9bacc37e6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130740676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:53Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefc5900-f35f-4e3a-8722-39345c69d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefc5900-f35f-4e3a-8722-39345c69d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62f3fa9-d9eb-4d8f-b4e6-e2d394fe8d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62f3fa9-d9eb-4d8f-b4e6-e2d394fe8d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88c43f7-3753-4d2e-a74b-8a3f8ab97fc0', 'volume_name': 'volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774ab95e-6eb7-4208-878b-aa994ec6364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774ab95e-6eb7-4208-878b-aa994ec6364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bd015a-ccb2-481b-bc94-3de10973602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0', 'volume_size': 1} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae3916b-d088-46bd-a63f-5d4b4f55bd2a]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:53 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:53 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (3b2fa384-3d3d-40a9-9aa6-c1083d511c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe734b5-9afc-4610-ad54-afbdbf6f4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe734b5-9afc-4610-ad54-afbdbf6f4427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813145039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fe40a-a485-40f4-bb33-8eb7cc08e229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:53Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4bbfe-79b3-4690-8f37-b73e3a738295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4bbfe-79b3-4690-8f37-b73e3a738295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493fcd6d-ac48-4f80-88f2-87c70c290239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493fcd6d-ac48-4f80-88f2-87c70c290239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0fe40a-a485-40f4-bb33-8eb7cc08e229', 'volume_name': 'volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2ad57d-a1ab-41fa-bf50-1ca2eb944ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2ad57d-a1ab-41fa-bf50-1ca2eb944ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1179d2-e541-459f-949a-43366d4bd0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:53 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume 7c0fe40a-a485-40f4-bb33-8eb7cc08e229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229', 'volume_size': 1} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:53 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1073741824" returned: 0 in 0.575s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:53 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 Jul 22 02:08:53 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:53 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:53 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:53 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:53 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (30909b74-2d53-4e38-8cd9-6785a9592010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ba59f-5d78-46a6-b69b-0de5befd2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ba59f-5d78-46a6-b69b-0de5befd2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487715005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4209a5-799d-4106-bc1a-1eb809e60fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:54Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf560b5-06ad-4b43-bf9c-e578808c3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf560b5-06ad-4b43-bf9c-e578808c3295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198c01fb-19bd-4625-8c24-c3aa165a8e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198c01fb-19bd-4625-8c24-c3aa165a8e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4209a5-799d-4106-bc1a-1eb809e60fd8', 'volume_name': 'volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f894af2-11f9-4126-8b63-30dcb6a26fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f894af2-11f9-4126-8b63-30dcb6a26fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a395daa-0d7e-4893-b4d6-c53ab7604e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume dd4209a5-799d-4106-bc1a-1eb809e60fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8', 'volume_size': 1} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25" returned: 0 in 0.412s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130740676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:53Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:54 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:54 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 1073741824 Jul 22 02:08:54 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Attempting download of 48a49dd6-b39e-43b2-9c94-ae293f830626 ((None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}])) to volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cfc509-502e-430d-937b-2b4c8ed2a1b5]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:54 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 1 in 0.648s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:54 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd Jul 22 02:08:54 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (b0996d5e-bec0-40b8-9e2f-081986f69c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec8aff-c2a1-4669-a889-163a21576fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec8aff-c2a1-4669-a889-163a21576fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625480720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da012e7-13c0-4ffb-a07f-3fb49eb474cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:54Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20b1466-703d-4a31-bfc6-6d748c4ab57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20b1466-703d-4a31-bfc6-6d748c4ab57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6155662-7db0-40ab-8e66-242b1f56be11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6155662-7db0-40ab-8e66-242b1f56be11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da012e7-13c0-4ffb-a07f-3fb49eb474cc', 'volume_name': 'volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d11cf1-6538-42a2-b0ab-139cc96a217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d11cf1-6538-42a2-b0ab-139cc96a217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03344052-19fa-460a-96a5-ab724afab27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:54 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume 4da012e7-13c0-4ffb-a07f-3fb49eb474cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc', 'volume_size': 1} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:54 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:54 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 1073741824" returned: 0 in 0.743s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd" returned: 0 in 0.627s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:54 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 Jul 22 02:08:54 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:54 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd Jul 22 02:08:54 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (bcab4dc1-7634-4942-a3b9-fa7a674683f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb9df43-eddd-49ec-9f7b-6a9de3fed00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb9df43-eddd-49ec-9f7b-6a9de3fed00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026629198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd130a6f-9bb5-4734-8c7c-8a001b0a7b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:55Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2acd4-2c21-4354-96c4-8b083d1a7f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f2acd4-2c21-4354-96c4-8b083d1a7f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3085e0fc-f017-4ea7-981a-c46f4f188fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3085e0fc-f017-4ea7-981a-c46f4f188fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd130a6f-9bb5-4734-8c7c-8a001b0a7b63', 'volume_name': 'volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90faefe0-3589-4195-9d4d-9817f06f2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90faefe0-3589-4195-9d4d-9817f06f2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb95332-097a-4726-9c27-345fecb21871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume bd130a6f-9bb5-4734-8c7c-8a001b0a7b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63', 'volume_size': 1} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813145039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0fe40a-a485-40f4-bb33-8eb7cc08e229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:53Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume 7c0fe40a-a485-40f4-bb33-8eb7cc08e229 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:55 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:55 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd" returned: 1 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48a49dd6-b39e-43b2-9c94-ae293f830626_2z0dg3nd' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4fd2cc-9ccd-4d97-bd94-004296207dc2]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:55 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 1073741824 Jul 22 02:08:55 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2bd015a-ccb2-481b-bc94-3de10973602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ee8c07-4970-46af-964e-b7927e3e3d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:55 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 (d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0): created successfully Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ee8c07-4970-46af-964e-b7927e3e3d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (4e5292d0-cdcb-4cf1-83f8-065f80989df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e6ddd88b-ec33-4e4b-86c7-abee5927def6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:55 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:55 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:55 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:55 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 1073741824" returned: 0 in 0.409s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:55 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 Jul 22 02:08:55 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:55 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD Jul 22 02:08:55 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:55 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-487715005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4209a5-799d-4106-bc1a-1eb809e60fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:54Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume dd4209a5-799d-4106-bc1a-1eb809e60fd8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:55 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:55 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] 48a49dd6-b39e-43b2-9c94-ae293f830626 was raw, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:08:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:56 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 1073741824 Jul 22 02:08:56 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1179d2-e541-459f-949a-43366d4bd0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73204da-d292-4ad5-a0b9-3d65b2a2b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:56 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 Jul 22 02:08:56 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 (7c0fe40a-a485-40f4-bb33-8eb7cc08e229): created successfully Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c73204da-d292-4ad5-a0b9-3d65b2a2b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (3b2fa384-3d3d-40a9-9aa6-c1083d511c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1bade6fa-5036-497c-9340-8ba77ee73c35 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:56 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 1073741824" returned: 0 in 0.481s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:56 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 Jul 22 02:08:56 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:56 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25" returned: 0 in 0.548s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48a49dd6-b39e-43b2-9c94-ae293f830626_ais49zqudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:56 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1G Jul 22 02:08:56 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:56 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.349s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd6953a-f000-46e7-af74-9d5131df1b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268512deedb543b1b31f0f09d8548189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:51Z,use_quota=True,user_id='5d9351db28af4f39adf759a2f17e7743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10218c10-6cee-4a6f-925a-af448075cd3b),volume_type_id=10218c10-6cee-4a6f-925a-af448075cd3b)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Creating volume 1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a395daa-0d7e-4893-b4d6-c53ab7604e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:56 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1073741824 Jul 22 02:08:56 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888a3b06-bf3a-4ae1-97ea-c8d402e02d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 (dd4209a5-799d-4106-bc1a-1eb809e60fd8): created successfully Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888a3b06-bf3a-4ae1-97ea-c8d402e02d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (30909b74-2d53-4e38-8cd9-6785a9592010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:56 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3a5aa76f-9a15-4166-a515-b0d67f12eb89 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:56 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 1G" returned: 0 in 0.432s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Downloaded image 48a49dd6-b39e-43b2-9c94-ae293f830626 ((None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}])) to volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Temporary image 48a49dd6-b39e-43b2-9c94-ae293f830626 for user d6f72e21ec974c529ba42f4a3813aa53 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:08:56 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Marking volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Copying metadata from image 48a49dd6-b39e-43b2-9c94-ae293f830626 to 08dcd04c-e4ae-4947-beef-5c1b8363cf25. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Creating volume glance metadata for volume 08dcd04c-e4ae-4947-beef-5c1b8363cf25 backed by image 48a49dd6-b39e-43b2-9c94-ae293f830626 with: {'image_id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '98309db49f4e076ba4bade0e5c11f082', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c801a92-4f0c-4f91-824f-e82c3325c944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25', 'volume_size': 1, 'image_id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48a49dd6-b39e-43b2-9c94-ae293f830626', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98309db49f4e076ba4bade0e5c11f082', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd7bb3b05a9143f09ec98dc03c3cceae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2606256024848f9a541927da6b2978aa70fd1ff63a1ce6b99d7809c00358e626e902ac6319e5e7fb1b9e6fde1ddea463dbe3ae850b8898ed48770df7c0b82ba5', 'id': '48a49dd6-b39e-43b2-9c94-ae293f830626', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48a49dd6-b39e-43b2-9c94-ae293f830626/file', 'properties': {}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce5c04-64df-494a-8914-d7a6aec59922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:57 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Volume volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 (08dcd04c-e4ae-4947-beef-5c1b8363cf25): created successfully Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ce5c04-64df-494a-8914-d7a6aec59922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Flow 'volume_create_manager' (d5c1a8a6-650d-4379-8b59-70bfd8fffdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4d95a370-e3bb-46bb-8af1-6f781d3983b9 tempest-VolumeImageDependencyTests-1612207454 None] Created volume successfully. Jul 22 02:08:57 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1073741824" returned: 0 in 0.581s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:57 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 Jul 22 02:08:57 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:57 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.079s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625480720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da012e7-13c0-4ffb-a07f-3fb49eb474cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:54Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume 4da012e7-13c0-4ffb-a07f-3fb49eb474cc {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:57 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc 1073741824 Jul 22 02:08:57 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Attempting download of 73342b22-9257-4bf3-8f20-f43c4f6afd4b ((None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}])) to volume 1cd6953a-f000-46e7-af74-9d5131df1b72. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b33d87-b701-49ec-97dc-49330050b9c1]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:57 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9 Jul 22 02:08:57 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9" returned: 0 in 0.380s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc 1073741824" returned: 0 in 0.559s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Acquiring lock "cinder-08dcd04c-e4ae-4947-beef-5c1b8363cf25-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:58 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc Jul 22 02:08:58 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9 Jul 22 02:08:58 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "cinder-08dcd04c-e4ae-4947-beef-5c1b8363cf25-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Acquiring lock "cinder-quobyte-08dcd04c-e4ae-4947-beef-5c1b8363cf25" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "cinder-quobyte-08dcd04c-e4ae-4947-beef-5c1b8363cf25" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e69d419-1a52-4bbf-868a-f4c4b56d4d22]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" returned: 0 in 0.338s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026629198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd130a6f-9bb5-4734-8c7c-8a001b0a7b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4423eb5bee3421fb503ef399308a751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:08:55Z,use_quota=True,user_id='345d9e3be5114af08a25c9446aa7c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Creating volume bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:08:58 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:58 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 Jul 22 02:08:58 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9" returned: 1 in 0.493s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_73342b22-9257-4bf3-8f20-f43c4f6afd4b_lh3gbou9' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea85d30-fe7e-4cdb-b5be-63d649fca3de]: (4, 'raw') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 1073741824 Jul 22 02:08:58 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03344052-19fa-460a-96a5-ab724afab27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd4a15c-9d80-49d3-81b5-2bbaab87a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc (4da012e7-13c0-4ffb-a07f-3fb49eb474cc): created successfully Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd4a15c-9d80-49d3-81b5-2bbaab87a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (b0996d5e-bec0-40b8-9e2f-081986f69c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5ab5fd0e-10e3-42c1-950d-3c6557196dd6 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:58 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:58 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:58 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25" returned: 0 in 0.454s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:58 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25 Jul 22 02:08:58 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:59 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:59 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 1073741824" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:59 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 Jul 22 02:08:59 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:59 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD Jul 22 02:08:59 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:59 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-08dcd04c-e4ae-4947-beef-5c1b8363cf25" returned: 0 in 0.351s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "cinder-quobyte-08dcd04c-e4ae-4947-beef-5c1b8363cf25" released by "delete_volume" :: held 0.881s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Created reservations ['d4c783b0-8aa7-459c-9b86-cc4e45db9e67', '9dc86385-aaa1-46cc-b08f-8045922d10c3', 'dce1e320-72af-4a88-b002-b0692fbef4a2', '3491a2ef-7c2e-4ab9-9e3f-9cce9e1ea8a6'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:08:59 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:59 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] 73342b22-9257-4bf3-8f20-f43c4f6afd4b was raw, converting to qcow2 {{(pid=87153) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:08:59 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:08:59 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb95332-097a-4726-9c27-345fecb21871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdbc1a4-303d-4f3d-9765-142b9713630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:08:59 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 Jul 22 02:08:59 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:08:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Volume volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 (bd130a6f-9bb5-4734-8c7c-8a001b0a7b63): created successfully Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdbc1a4-303d-4f3d-9765-142b9713630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Flow 'volume_create_manager' (bcab4dc1-7634-4942-a3b9-fa7a674683f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:08:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9c7a348d-71d8-48e3-8602-2d9eb1d4eeee tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created volume successfully. Jul 22 02:08:59 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:08:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Deleted volume successfully. Jul 22 02:08:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-16245b9d-8609-48a7-9db4-37db298ccb38 tempest-VolumeImageDependencyTests-1612207454 None] Lock "cinder-08dcd04c-e4ae-4947-beef-5c1b8363cf25-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:00 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72" returned: 0 in 0.529s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_73342b22-9257-4bf3-8f20-f43c4f6afd4b_6t832jy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:09:00 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Converted 0.00 MB image at 0.00 MB/s Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:00 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1G Jul 22 02:09:00 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:00 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 1G" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Downloaded image 73342b22-9257-4bf3-8f20-f43c4f6afd4b ((None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}])) to volume 1cd6953a-f000-46e7-af74-9d5131df1b72 successfully. {{(pid=87153) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Temporary image 73342b22-9257-4bf3-8f20-f43c4f6afd4b for user 5d9351db28af4f39adf759a2f17e7743 is deleted. {{(pid=87153) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.volume_utils [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Marking volume 1cd6953a-f000-46e7-af74-9d5131df1b72 as bootable. {{(pid=87153) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Copying metadata from image 73342b22-9257-4bf3-8f20-f43c4f6afd4b to 1cd6953a-f000-46e7-af74-9d5131df1b72. {{(pid=87153) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Creating volume glance metadata for volume 1cd6953a-f000-46e7-af74-9d5131df1b72 backed by image 73342b22-9257-4bf3-8f20-f43c4f6afd4b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fd7d20657e2be4868ee0488baab47947', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87153) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d907a97-149d-4a25-b13f-5a6ab9b57968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd6953a-f000-46e7-af74-9d5131df1b72', 'volume_size': 1, 'image_id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd7d20657e2be4868ee0488baab47947', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '268512deedb543b1b31f0f09d8548189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd41a502b8a455250d224700bc8feb79701dd1bf82bc4b84044e0f22a8e67864f54cf1c2c2dfcdc0dd148614a1b41a51ad5a43f5745f0bc242ffbe9eaaca245cc', 'id': '73342b22-9257-4bf3-8f20-f43c4f6afd4b', 'created_at': datetime.datetime(2026, 7, 22, 0, 8, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 22, 0, 8, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/73342b22-9257-4bf3-8f20-f43c4f6afd4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528e5ca0-eac0-4e78-92da-9db2798df7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Volume volume-1cd6953a-f000-46e7-af74-9d5131df1b72 (1cd6953a-f000-46e7-af74-9d5131df1b72): created successfully Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528e5ca0-eac0-4e78-92da-9db2798df7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Flow 'volume_create_manager' (9be25f8e-22ab-4907-ae0c-b0bff6f496b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-420d9954-9423-4c8f-87e6-4679d99c07a7 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Created volume successfully. Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2406550-9795-4876-a280-647896e746e4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:00 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 Jul 22 02:09:00 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:01 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" returned: 0 in 0.443s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:01 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63 Jul 22 02:09:01 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Acquiring lock "cinder-1cd6953a-f000-46e7-af74-9d5131df1b72-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "cinder-1cd6953a-f000-46e7-af74-9d5131df1b72-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Acquiring lock "cinder-quobyte-1cd6953a-f000-46e7-af74-9d5131df1b72" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "cinder-quobyte-1cd6953a-f000-46e7-af74-9d5131df1b72" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9c5cb-c80e-49c0-86e0-ca372a212971]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:01 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" returned: 0 in 0.385s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63" released by "delete_volume" :: held 0.893s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:01 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 Jul 22 02:09:01 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['19692f9b-3d53-45ed-826a-1220f79d05f3', '5929d4b5-c4d1-46c6-b57e-f972efde81ed', 'f194b602-3744-4e6a-b534-53aa2be5ffd3', '901693ce-5e6a-4ac2-ba4c-6961f434d41e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-4da012e7-13c0-4ffb-a07f-3fb49eb474cc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:01 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:01 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-4da012e7-13c0-4ffb-a07f-3fb49eb474cc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd2f77-8cfa-455c-9d88-94d32bedde52]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:02 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72" returned: 0 in 0.547s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:02 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72 Jul 22 02:09:02 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:02 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc Jul 22 02:09:02 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:02 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ee7f0bfe-42f0-44b3-80b7-b750d1cd3c8c tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-bd130a6f-9bb5-4734-8c7c-8a001b0a7b63-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:02 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-1cd6953a-f000-46e7-af74-9d5131df1b72" returned: 0 in 0.409s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "cinder-quobyte-1cd6953a-f000-46e7-af74-9d5131df1b72" released by "delete_volume" :: held 1.017s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:02 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" returned: 0 in 0.543s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Created reservations ['ee904f65-039f-4209-92b2-b1aed08c049a', '298e3462-e289-4406-9199-74c035dd2641', '4f6b5ffe-4d4f-44e5-8b59-5a02a0a3753b', '93567a90-a869-4e37-9a3f-91be9ad3626f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:02 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc Jul 22 02:09:02 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:02 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:02 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:02 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" returned: 0 in 0.295s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-4da012e7-13c0-4ffb-a07f-3fb49eb474cc" released by "delete_volume" :: held 0.897s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['7d4de04b-3f04-4e7b-bfec-4767a4b19310', '060b6100-c52e-4b58-ab64-da15e97f801f', 'b90034dc-729b-4d96-8a76-4ecb1f418422', 'f8f15a22-16c7-4332-a7f4-f125d29e52c1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:03 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.389s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Deleted volume successfully. Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8d13216c-c0b9-4c7e-bc72-45d45a3b8d02 tempest-VolumeAndVolumeTypeFromImageTest-173104968 None] Lock "cinder-1cd6953a-f000-46e7-af74-9d5131df1b72-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:03 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:03 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:03 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.309s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-607843a6-c6c0-4d5c-9e30-b829f1e271d5 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-4da012e7-13c0-4ffb-a07f-3fb49eb474cc-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-dd4209a5-799d-4106-bc1a-1eb809e60fd8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-dd4209a5-799d-4106-bc1a-1eb809e60fd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-dd4209a5-799d-4106-bc1a-1eb809e60fd8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-dd4209a5-799d-4106-bc1a-1eb809e60fd8" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8ed9d1-36e9-4b6c-b3a1-34f489ac01bc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:04 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 Jul 22 02:09:04 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:04 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8" returned: 0 in 0.391s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:04 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8 Jul 22 02:09:04 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:04 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-dd4209a5-799d-4106-bc1a-1eb809e60fd8" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-dd4209a5-799d-4106-bc1a-1eb809e60fd8" released by "delete_volume" :: held 0.744s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['672cf709-d4ca-4511-951b-b734bc8d8438', 'ac6712d9-ebd7-41ff-a8b6-2db48a3892d9', '440a5f29-9b90-478d-912a-75e2a6a9e481', '92db26ca-98ed-4562-9e75-e213683a2708'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:05 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:05 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-7c0fe40a-a485-40f4-bb33-8eb7cc08e229-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-7c0fe40a-a485-40f4-bb33-8eb7cc08e229-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[1850b935-30e3-48ae-94aa-9acaed31e1e1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:05 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 Jul 22 02:09:05 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:05 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.524s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:05 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b2ae5625-1389-4c25-9bac-527a9c27b489 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-dd4209a5-799d-4106-bc1a-1eb809e60fd8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:06 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" returned: 0 in 0.441s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:06 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229 Jul 22 02:09:06 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:06 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-7c0fe40a-a485-40f4-bb33-8eb7cc08e229" released by "delete_volume" :: held 0.807s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['05c49bb7-5669-488c-98ac-483915e0868b', '887dfe8b-facf-4c84-addc-d2d37d66a000', '94c230bf-5fbe-4faf-a7fd-925dc4eef3d9', '96ccd55c-1846-4abc-a247-08bb74da4209'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:06 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:06 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec999f4b-32df-4aa6-9c8d-db7dcb595b80]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:06 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:06 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:06 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ffa587b4-1025-4f62-8874-77ed94fe7c93 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-7c0fe40a-a485-40f4-bb33-8eb7cc08e229-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:07 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" returned: 0 in 0.499s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:07 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0 Jul 22 02:09:07 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:07 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0" released by "delete_volume" :: held 0.910s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['99201a6c-82b2-46bd-a747-3f2d98233940', '05829f2d-ca49-4158-a229-0aefb0e8f3d8', '75b45f62-3cd5-48c5-9b33-c68c1005a234', '964c0007-fe39-4e88-9b5e-b479b73bbbb1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:07 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:07 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-c56f8349-2ff2-4d71-900b-3c0f89fb184f-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-c56f8349-2ff2-4d71-900b-3c0f89fb184f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-c56f8349-2ff2-4d71-900b-3c0f89fb184f" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-c56f8349-2ff2-4d71-900b-3c0f89fb184f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleting offline snapshot c56f8349-2ff2-4d71-900b-3c0f89fb184f of volume b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] snapshot_file for this snap is: volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc5766-7ac6-475f-bedf-5a45bb74f820]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:08 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:08 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d825341b-e9c2-490a-9d91-3a5ea8d0825b tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-d88c43f7-3753-4d2e-a74b-8a3f8ab97fc0-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:08 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f Jul 22 02:09:08 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:08 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f" returned: 0 in 0.547s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b629b21b-5d85-4d68-9702-e27f42e9657c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73746fe-9c17-4d85-a002-70abaaa34dab]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:08 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c Jul 22 02:09:08 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:09 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c" returned: 0 in 0.391s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:09 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f Jul 22 02:09:09 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:09 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f" returned: 0 in 0.416s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:09 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f Jul 22 02:09:09 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:09 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c.c56f8349-2ff2-4d71-900b-3c0f89fb184f" returned: 0 in 0.293s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-c56f8349-2ff2-4d71-900b-3c0f89fb184f" released by "_delete_snapshot" :: held 1.806s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" released by "delete_snapshot" :: held 1.851s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:09 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['24f132f1-f061-469c-9ece-ca11c4529616', '64ce5fa2-ddf0-47d0-be8a-6b1a6930f3cc', 'd0a198ce-5d9b-49c4-98e9-07d2c3851d25', '480b4d09-3fc1-42d9-b9d4-b195a1f1fbd9'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:10 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Delete snapshot completed successfully. Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c49ec6d6-f131-4686-81b1-f69943724ce1 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-c56f8349-2ff2-4d71-900b-3c0f89fb184f-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (841ddf81-e86d-4585-afac-0921632c4454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492f5a5-b3a9-44cb-a430-156d699e6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492f5a5-b3a9-44cb-a430-156d699e6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1174658245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3fc7a9-a8d9-4e81-9c65-727131fe97cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:10Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb67d5-b02f-46b4-9362-55b0950c24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb67d5-b02f-46b4-9362-55b0950c24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b16381-2f80-4ffd-9175-1a2c8b592bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b16381-2f80-4ffd-9175-1a2c8b592bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3fc7a9-a8d9-4e81-9c65-727131fe97cf', 'volume_name': 'volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc199d2-f698-4b30-88b8-f730beb5a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc199d2-f698-4b30-88b8-f730beb5a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9ff2fd-ed73-4cbd-98bd-4bdd1baff2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:10 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Volume 6b3fc7a9-a8d9-4e81-9c65-727131fe97cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf', 'volume_size': 1} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1174658245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3fc7a9-a8d9-4e81-9c65-727131fe97cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:10Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Creating volume 6b3fc7a9-a8d9-4e81-9c65-727131fe97cf {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:10 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:10 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf 1073741824 Jul 22 02:09:10 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-b629b21b-5d85-4d68-9702-e27f42e9657c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-b629b21b-5d85-4d68-9702-e27f42e9657c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a9fb92-9708-4513-b0e0-5345495c58a1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:10 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c Jul 22 02:09:10 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:11 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf 1073741824" returned: 0 in 0.632s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:11 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf Jul 22 02:09:11 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:11 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c" returned: 0 in 0.611s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:11 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c Jul 22 02:09:11 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (a5500a85-4c05-4cf4-8b4e-427fbc8ec925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:11 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75134c7b-1227-4e84-a3d5-7f4d2bd54a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" returned: 0 in 0.393s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75134c7b-1227-4e84-a3d5-7f4d2bd54a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954314102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac11fae-aca8-42e7-b94e-5f5c3d324f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:11Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cb2ab7-a263-4f66-b345-15c6b1e8130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3cb2ab7-a263-4f66-b345-15c6b1e8130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e0657-54f3-4aa0-9ddd-7c6d78597aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e0657-54f3-4aa0-9ddd-7c6d78597aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac11fae-aca8-42e7-b94e-5f5c3d324f06', 'volume_name': 'volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021fbf17-302f-45ec-9b3e-8445bdf07a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021fbf17-302f-45ec-9b3e-8445bdf07a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02d75c-30a1-433a-8064-a63a54d65454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Volume eac11fae-aca8-42e7-b94e-5f5c3d324f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06', 'volume_size': 1} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-954314102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac11fae-aca8-42e7-b94e-5f5c3d324f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:11Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Creating volume eac11fae-aca8-42e7-b94e-5f5c3d324f06 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:11 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:11 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 1073741824 Jul 22 02:09:11 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9ff2fd-ed73-4cbd-98bd-4bdd1baff2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a624e168-0720-4fc8-9fb6-8dd96560d314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:11 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Volume volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf (6b3fc7a9-a8d9-4e81-9c65-727131fe97cf): created successfully Jul 22 02:09:11 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a624e168-0720-4fc8-9fb6-8dd96560d314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (841ddf81-e86d-4585-afac-0921632c4454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-b629b21b-5d85-4d68-9702-e27f42e9657c" returned: 0 in 0.462s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f92fd49f-32cc-41bd-bb06-d15e74290d90 tempest-CreateVolumesFromImageTest-1997458686 None] Created volume successfully. Jul 22 02:09:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-quobyte-b629b21b-5d85-4d68-9702-e27f42e9657c" released by "delete_volume" :: held 1.163s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (74767df4-4d1b-4368-a747-c3e89d563c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10071bf-1eba-44f7-b3c5-1f59803c080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10071bf-1eba-44f7-b3c5-1f59803c080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-669222516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e55a95-c8db-45bf-b143-7c1962fb1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:12Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc40970-7f0f-4d4d-84f6-ffbdd76cc7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc40970-7f0f-4d4d-84f6-ffbdd76cc7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4eb90d-b2a6-4cdd-92c4-a1105889809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4eb90d-b2a6-4cdd-92c4-a1105889809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e55a95-c8db-45bf-b143-7c1962fb1357', 'volume_name': 'volume-86e55a95-c8db-45bf-b143-7c1962fb1357', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f089d62d-893b-461e-ab90-0c8ee04acc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f089d62d-893b-461e-ab90-0c8ee04acc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebd15c4-ab76-4547-b750-d42b560d87ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Volume 86e55a95-c8db-45bf-b143-7c1962fb1357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e55a95-c8db-45bf-b143-7c1962fb1357', 'volume_size': 1} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Created reservations ['fdc501cf-f971-4a27-8154-554d99a24e61', '961e1873-22d9-4224-b17f-226c92048e19', '56cc7c81-ac40-4e7a-a6f9-be1de3b28a35', '61bdee7b-b961-4ab0-a8fa-40f3a0d4133e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (9caa3e68-5552-4e0c-8ffa-ba8c0a9eb8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6d71ed-f62c-4223-9e72-67b278a954e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6d71ed-f62c-4223-9e72-67b278a954e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594974448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda19ab1-2087-41e7-b79e-7988cb9b0277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:12Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7db76da-bf49-43e4-ad64-b317c8fd1260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7db76da-bf49-43e4-ad64-b317c8fd1260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29071b-3d16-4b72-a0f9-68d95bef2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29071b-3d16-4b72-a0f9-68d95bef2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda19ab1-2087-41e7-b79e-7988cb9b0277', 'volume_name': 'volume-cda19ab1-2087-41e7-b79e-7988cb9b0277', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935a6d5-0606-456f-9b6a-6057b51ead86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935a6d5-0606-456f-9b6a-6057b51ead86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e0c0cd-48ea-435f-9cfa-f6a7dffc97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:12 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Volume cda19ab1-2087-41e7-b79e-7988cb9b0277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda19ab1-2087-41e7-b79e-7988cb9b0277', 'volume_size': 1} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:12 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 1073741824" returned: 0 in 0.760s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:12 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 Jul 22 02:09:12 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:12 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.374s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Deleted volume successfully. Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf1deaec-2890-46df-bef4-4a625ef51f46 tempest-CreateVolumesFromSnapshotTest-2036959676 None] Lock "cinder-b629b21b-5d85-4d68-9702-e27f42e9657c-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:12 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06" returned: 0 in 0.392s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-669222516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e55a95-c8db-45bf-b143-7c1962fb1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:12Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Creating volume 86e55a95-c8db-45bf-b143-7c1962fb1357 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:12 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:12 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 1073741824 Jul 22 02:09:12 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02d75c-30a1-433a-8064-a63a54d65454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cb6454-2f55-496c-9293-5739b3efdd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (acf47dae-89fb-49e4-9747-75610e03ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99953d74-39c0-4fbd-a191-3abb00d42673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Volume volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 (eac11fae-aca8-42e7-b94e-5f5c3d324f06): created successfully Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cb6454-2f55-496c-9293-5739b3efdd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (a5500a85-4c05-4cf4-8b4e-427fbc8ec925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99953d74-39c0-4fbd-a191-3abb00d42673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810314513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8651504a-84e6-45b1-bcc1-f0708caca3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:13Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d609354d-0cde-4d92-9337-340127d8c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d609354d-0cde-4d92-9337-340127d8c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad9b07c-f916-4acb-b68b-71f086b6e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad9b07c-f916-4acb-b68b-71f086b6e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8651504a-84e6-45b1-bcc1-f0708caca3b4', 'volume_name': 'volume-8651504a-84e6-45b1-bcc1-f0708caca3b4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016bfe2e-7503-4d99-9482-440311115048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016bfe2e-7503-4d99-9482-440311115048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae63444-341e-4848-bd39-cfda9ab13a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Volume 8651504a-84e6-45b1-bcc1-f0708caca3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8651504a-84e6-45b1-bcc1-f0708caca3b4', 'volume_size': 1} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-50a7dfa4-4e0e-402e-ab8a-588d75d04d5d tempest-CreateVolumesFromImageTest-1997458686 None] Created volume successfully. Jul 22 02:09:13 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 1073741824" returned: 0 in 0.510s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:13 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 Jul 22 02:09:13 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:13 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594974448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda19ab1-2087-41e7-b79e-7988cb9b0277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:12Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Creating volume cda19ab1-2087-41e7-b79e-7988cb9b0277 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebd15c4-ab76-4547-b750-d42b560d87ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e55a95-c8db-45bf-b143-7c1962fb1357', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 1073741824 Jul 22 02:09:13 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9eeb01-5343-4b3d-9d15-ce5eb9dd9216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Volume volume-86e55a95-c8db-45bf-b143-7c1962fb1357 (86e55a95-c8db-45bf-b143-7c1962fb1357): created successfully Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9eeb01-5343-4b3d-9d15-ce5eb9dd9216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (74767df4-4d1b-4368-a747-c3e89d563c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e704b19d-bfa1-4338-9317-26f5fee5b37b tempest-CreateVolumesFromImageTest-1997458686 None] Created volume successfully. Jul 22 02:09:14 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 1073741824" returned: 0 in 0.699s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:14 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 Jul 22 02:09:14 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:14 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810314513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8651504a-84e6-45b1-bcc1-f0708caca3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dec27b2ab754feda2866f2e80c56757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:13Z,use_quota=True,user_id='0af6b4caa9484f23a9608940c9235ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Creating volume 8651504a-84e6-45b1-bcc1-f0708caca3b4 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:14 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e0c0cd-48ea-435f-9cfa-f6a7dffc97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda19ab1-2087-41e7-b79e-7988cb9b0277', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:14 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 1073741824 Jul 22 02:09:14 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6318e9c8-addc-4155-8d74-6d9d997be616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:15 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Volume volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 (cda19ab1-2087-41e7-b79e-7988cb9b0277): created successfully Jul 22 02:09:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6318e9c8-addc-4155-8d74-6d9d997be616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:15 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (9caa3e68-5552-4e0c-8ffa-ba8c0a9eb8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:15 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-6e5a18bb-bd83-416b-83be-0cfdc8ac1345 tempest-CreateVolumesFromImageTest-1997458686 None] Created volume successfully. Jul 22 02:09:15 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 1073741824" returned: 0 in 0.749s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:15 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 Jul 22 02:09:15 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:16 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae63444-341e-4848-bd39-cfda9ab13a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8651504a-84e6-45b1-bcc1-f0708caca3b4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c74b884-af50-4737-b051-d48d985278ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:16 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Volume volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 (8651504a-84e6-45b1-bcc1-f0708caca3b4): created successfully Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c74b884-af50-4737-b051-d48d985278ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Flow 'volume_create_manager' (acf47dae-89fb-49e4-9747-75610e03ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f8a30bd9-875f-49eb-a225-2c4a0662b4da tempest-CreateVolumesFromImageTest-1997458686 None] Created volume successfully. Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-8651504a-84e6-45b1-bcc1-f0708caca3b4-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-8651504a-84e6-45b1-bcc1-f0708caca3b4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-quobyte-8651504a-84e6-45b1-bcc1-f0708caca3b4" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-8651504a-84e6-45b1-bcc1-f0708caca3b4" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e8a853-c142-4479-b2d4-1793835b291a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:16 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 Jul 22 02:09:16 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:17 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:17 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4 Jul 22 02:09:17 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:17 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8651504a-84e6-45b1-bcc1-f0708caca3b4" returned: 0 in 0.291s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-8651504a-84e6-45b1-bcc1-f0708caca3b4" released by "delete_volume" :: held 0.760s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Created reservations ['5b497522-ba4c-41d0-93a7-98a58e81844b', '170f2f82-98a5-429e-9c60-1e1732415215', '128763c5-31f0-4a05-83df-99a98b1b5ef8', 'f7351566-6732-4680-9ac5-3e28845e2dc8'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:17 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:17 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:17 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.310s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:17 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:17 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Deleted volume successfully. Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8694ff9d-40d2-43fb-aa65-b061e9ee56bb tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-8651504a-84e6-45b1-bcc1-f0708caca3b4-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-cda19ab1-2087-41e7-b79e-7988cb9b0277-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-cda19ab1-2087-41e7-b79e-7988cb9b0277-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-quobyte-cda19ab1-2087-41e7-b79e-7988cb9b0277" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0f454210-52eb-448b-8d8a-18f4ae648e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62022d46-106d-4a90-ba1c-fb9c027d0160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62022d46-106d-4a90-ba1c-fb9c027d0160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349782716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6085ed41-3db0-4aae-bde9-f69170ad5b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:18Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8ce1d3-91dc-479a-9372-7dabe8f1f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8ce1d3-91dc-479a-9372-7dabe8f1f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c2f83-45a0-4c92-90e4-53952bcbaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c2f83-45a0-4c92-90e4-53952bcbaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6085ed41-3db0-4aae-bde9-f69170ad5b48', 'volume_name': 'volume-6085ed41-3db0-4aae-bde9-f69170ad5b48', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f529dc1c-7f70-4a02-b5c6-185d783377e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f529dc1c-7f70-4a02-b5c6-185d783377e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c86fc-adc0-4f5f-8d0e-805db94cda0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume 6085ed41-3db0-4aae-bde9-f69170ad5b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6085ed41-3db0-4aae-bde9-f69170ad5b48', 'volume_size': 1} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1349782716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6085ed41-3db0-4aae-bde9-f69170ad5b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:18Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume 6085ed41-3db0-4aae-bde9-f69170ad5b48 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-cda19ab1-2087-41e7-b79e-7988cb9b0277" acquired by "delete_volume" :: waited 0.129s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:18 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 1073741824 Jul 22 02:09:18 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b859c-bdfb-4707-b433-37e97b372a0f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:18 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 Jul 22 02:09:18 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Flow 'volume_create_manager' (9d83769c-eb8a-4035-ae42-c4874cc7b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a532a-b03c-427a-82ac-f62687186b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a532a-b03c-427a-82ac-f62687186b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-489045422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2049eac9-f776-4cae-80c7-b2ccb19936a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0df5bbb68345afb756751b7ad3d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:19Z,use_quota=True,user_id='d8a64d22a4124f109e06505218d9a0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c09b0dc-87c0-448e-9c37-9716fc6dbc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c09b0dc-87c0-448e-9c37-9716fc6dbc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84483f48-00ce-4745-9f4c-ba411711897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84483f48-00ce-4745-9f4c-ba411711897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2049eac9-f776-4cae-80c7-b2ccb19936a2', 'volume_name': 'volume-2049eac9-f776-4cae-80c7-b2ccb19936a2', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24b80b5-c951-49f8-8a0f-a09235a8aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24b80b5-c951-49f8-8a0f-a09235a8aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acff782-3f16-41c3-a0fc-656900ef5738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Volume 2049eac9-f776-4cae-80c7-b2ccb19936a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2049eac9-f776-4cae-80c7-b2ccb19936a2', 'volume_size': 1} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:18 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 1073741824" returned: 0 in 0.590s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:19 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 Jul 22 02:09:19 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:19 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277" returned: 0 in 0.621s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:19 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277 Jul 22 02:09:19 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:19 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cda19ab1-2087-41e7-b79e-7988cb9b0277" returned: 0 in 0.301s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-cda19ab1-2087-41e7-b79e-7988cb9b0277" released by "delete_volume" :: held 1.005s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:19 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48" returned: 0 in 0.420s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-489045422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2049eac9-f776-4cae-80c7-b2ccb19936a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0df5bbb68345afb756751b7ad3d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:19Z,use_quota=True,user_id='d8a64d22a4124f109e06505218d9a0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Creating volume 2049eac9-f776-4cae-80c7-b2ccb19936a2 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:19 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192c86fc-adc0-4f5f-8d0e-805db94cda0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6085ed41-3db0-4aae-bde9-f69170ad5b48', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8581c3a6-5c5a-428e-9b8e-7c45e6bc32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:19 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 1073741824 Jul 22 02:09:19 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 (6085ed41-3db0-4aae-bde9-f69170ad5b48): created successfully Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8581c3a6-5c5a-428e-9b8e-7c45e6bc32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0f454210-52eb-448b-8d8a-18f4ae648e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-26b88406-8141-45b5-bffc-bcc1634f7f63 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Created reservations ['d9b51af2-6abf-41f4-a162-c71b48731b06', '90c15f71-bffd-40b5-b605-4928681a792f', '1de4b304-df23-4486-928e-60ebd502b9ed', '7d008d22-fbbc-4ff0-b416-5a1239efaaf7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:19 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:19 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:19 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 1073741824" returned: 0 in 0.509s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:19 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Deleted volume successfully. Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-981f2b44-a1c7-4a4b-80c5-0d6311d4c439 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-cda19ab1-2087-41e7-b79e-7988cb9b0277-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:20 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 Jul 22 02:09:20 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:20 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acff782-3f16-41c3-a0fc-656900ef5738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2049eac9-f776-4cae-80c7-b2ccb19936a2', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3650eed5-bd3b-47af-8654-bb2f8429b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:20 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Volume volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 (2049eac9-f776-4cae-80c7-b2ccb19936a2): created successfully Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3650eed5-bd3b-47af-8654-bb2f8429b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Flow 'volume_create_manager' (9d83769c-eb8a-4035-ae42-c4874cc7b89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5ad323a9-733d-4c43-8bb6-d543c33653a6 tempest-ProjectReaderTests-1763688711 None] Created volume successfully. Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-86e55a95-c8db-45bf-b143-7c1962fb1357-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-86e55a95-c8db-45bf-b143-7c1962fb1357-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-quobyte-86e55a95-c8db-45bf-b143-7c1962fb1357" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-86e55a95-c8db-45bf-b143-7c1962fb1357" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1210775-ddb3-46cc-861e-f6d3808107b7]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:20 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 Jul 22 02:09:20 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (73bfbe44-ca3c-494a-82e4-e01be0303a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180c2ea7-b150-4a21-b4ab-35edc09de4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180c2ea7-b150-4a21-b4ab-35edc09de4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045205268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5819a1-6341-4216-9418-807d562f7850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:21Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bf9a88-733e-47ab-8674-099013a16d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1bf9a88-733e-47ab-8674-099013a16d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e74602b-fc62-4a87-891f-f4896406c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e74602b-fc62-4a87-891f-f4896406c124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a5819a1-6341-4216-9418-807d562f7850', 'volume_name': 'volume-9a5819a1-6341-4216-9418-807d562f7850', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e41e31-58ea-4a09-acce-4d2db57f7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e41e31-58ea-4a09-acce-4d2db57f7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd1816a-9b24-4939-b7cd-39c3c0f0cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:21 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume 9a5819a1-6341-4216-9418-807d562f7850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a5819a1-6341-4216-9418-807d562f7850', 'volume_size': 1} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045205268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5819a1-6341-4216-9418-807d562f7850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:21Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume 9a5819a1-6341-4216-9418-807d562f7850 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:21 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:21 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357" returned: 0 in 0.538s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:21 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 1073741824 Jul 22 02:09:21 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:21 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357 Jul 22 02:09:21 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "cinder-2049eac9-f776-4cae-80c7-b2ccb19936a2-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "cinder-2049eac9-f776-4cae-80c7-b2ccb19936a2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "cinder-quobyte-2049eac9-f776-4cae-80c7-b2ccb19936a2" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "cinder-quobyte-2049eac9-f776-4cae-80c7-b2ccb19936a2" acquired by "delete_volume" :: waited 0.036s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[94800fe8-50e3-42e6-b9ba-ef597e029cda]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:21 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 Jul 22 02:09:21 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:21 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-86e55a95-c8db-45bf-b143-7c1962fb1357" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-86e55a95-c8db-45bf-b143-7c1962fb1357" released by "delete_volume" :: held 1.122s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:21 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Created reservations ['0714648e-73cc-413c-b347-a6c66aee8b5a', '68c02050-c9c5-4ff1-afa4-002d3f56f42c', '352c5077-ba1b-45c6-8ac9-64d0d57a7781', '0f09c035-0559-4454-a066-71ebb137eab7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0d1343a1-c203-4d3e-8f73-5a11e13f0f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b49031-9c3b-4444-930f-3baae16bafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2" returned: 0 in 0.531s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b49031-9c3b-4444-930f-3baae16bafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961264712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a295289-b8f8-42ca-a6dd-8f0b92f30808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:22Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2 Jul 22 02:09:22 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c409bdaf-f70f-4607-9fff-a0c669b96af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c409bdaf-f70f-4607-9fff-a0c669b96af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2d9ab3-a965-4133-a815-da322fecc029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2d9ab3-a965-4133-a815-da322fecc029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a295289-b8f8-42ca-a6dd-8f0b92f30808', 'volume_name': 'volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742f313-c641-45f1-960b-520f59d2835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1742f313-c641-45f1-960b-520f59d2835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bdb298-e5c1-4cfb-93e0-ed9ec5b5175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume 3a295289-b8f8-42ca-a6dd-8f0b92f30808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808', 'volume_size': 1} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 1073741824" returned: 0 in 0.992s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0cbe4ebd-3089-4520-a1eb-3cc53c87d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba4fe01-8935-49c9-9403-d59b4195c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba4fe01-8935-49c9-9403-d59b4195c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488039584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea85e42-f714-4a2d-bf06-98393d3979bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:22Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897608ef-0da0-420a-ae26-8c3c3024b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 Jul 22 02:09:22 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897608ef-0da0-420a-ae26-8c3c3024b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f718c-4a4b-4327-9b13-13f010db1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f718c-4a4b-4327-9b13-13f010db1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea85e42-f714-4a2d-bf06-98393d3979bc', 'volume_name': 'volume-9ea85e42-f714-4a2d-bf06-98393d3979bc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c01f875-1897-41ef-a88f-475d12d59153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c01f875-1897-41ef-a88f-475d12d59153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988e890e-5d44-4c19-8c5a-d0714b5fe21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume 9ea85e42-f714-4a2d-bf06-98393d3979bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea85e42-f714-4a2d-bf06-98393d3979bc', 'volume_size': 1} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-2049eac9-f776-4cae-80c7-b2ccb19936a2" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "cinder-quobyte-2049eac9-f776-4cae-80c7-b2ccb19936a2" released by "delete_volume" :: held 1.063s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:22 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:22 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (7ae09fee-edf1-4fd8-be75-d225d05fa5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1536f7db-5be4-43de-a59a-929c00bef09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1536f7db-5be4-43de-a59a-929c00bef09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736632852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb163ba-17df-4ceb-a965-32202d26ff4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:23Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645c4bac-8ccc-4261-b66c-1f911c749762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645c4bac-8ccc-4261-b66c-1f911c749762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d22e57-5ab0-4ccd-a68c-d149a3eeaac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d22e57-5ab0-4ccd-a68c-d149a3eeaac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb163ba-17df-4ceb-a965-32202d26ff4b', 'volume_name': 'volume-cbb163ba-17df-4ceb-a965-32202d26ff4b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a120c-c69b-40bd-a6e1-04f5a52fc125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865a120c-c69b-40bd-a6e1-04f5a52fc125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a99c3e-5e71-4244-858a-97393cc8b2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:22 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume cbb163ba-17df-4ceb-a965-32202d26ff4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb163ba-17df-4ceb-a965-32202d26ff4b', 'volume_size': 1} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850" returned: 0 in 0.450s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961264712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a295289-b8f8-42ca-a6dd-8f0b92f30808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:22Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume 3a295289-b8f8-42ca-a6dd-8f0b92f30808 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:22 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-eac11fae-aca8-42e7-b94e-5f5c3d324f06-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:22 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 1073741824 Jul 22 02:09:22 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:22 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd1816a-9b24-4939-b7cd-39c3c0f0cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5819a1-6341-4216-9418-807d562f7850', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fd286a-dfd1-49f4-b857-b1d61c8d5f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Created reservations ['a1be46bb-6eb9-4daa-8047-cbfc0009b3e2', 'b6e8129b-af7b-4c33-8aea-87214836a205', '24c95882-cfbd-4041-8712-c06d6746d7cb', '78f30b4e-067d-4fc8-b548-797769410d78'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.478s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-eac11fae-aca8-42e7-b94e-5f5c3d324f06-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-9a5819a1-6341-4216-9418-807d562f7850 (9a5819a1-6341-4216-9418-807d562f7850): created successfully Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fd286a-dfd1-49f4-b857-b1d61c8d5f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (73bfbe44-ca3c-494a-82e4-e01be0303a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Deleted volume successfully. Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-594e0dd4-97e3-4ffa-9577-f5a3daf65a1a tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-quobyte-eac11fae-aca8-42e7-b94e-5f5c3d324f06" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7dc89cdf-b37c-4073-8662-5aed68f4968d tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-86e55a95-c8db-45bf-b143-7c1962fb1357-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (beec0121-24f7-415b-9a70-e9c1b760c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e52965f-09b9-4e4f-94a0-b46d8293e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-eac11fae-aca8-42e7-b94e-5f5c3d324f06" acquired by "delete_volume" :: waited 0.055s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e52965f-09b9-4e4f-94a0-b46d8293e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886250482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaeef63-00ae-4ff5-8670-e1ab17c5683f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:23Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398826ec-6a3e-4531-a871-058e05377312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398826ec-6a3e-4531-a871-058e05377312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ed848b-90a9-4281-ba1c-5b929f0c7376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ed848b-90a9-4281-ba1c-5b929f0c7376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afaeef63-00ae-4ff5-8670-e1ab17c5683f', 'volume_name': 'volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3f9f8-06a1-4e02-aaf7-3d07ab3e421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3f9f8-06a1-4e02-aaf7-3d07ab3e421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3324e92-8b24-4922-baa8-4f8ebdeefa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume afaeef63-00ae-4ff5-8670-e1ab17c5683f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f', 'volume_size': 1} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfdef05-dec6-4539-bf57-9d18f28cf372]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:23 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:23 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:23 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 Jul 22 02:09:23 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:23 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 1073741824" returned: 0 in 0.650s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:23 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 Jul 22 02:09:23 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:23 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.303s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Deleted volume successfully. Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b513e2ba-e224-4356-811c-21ecbc744568 tempest-ProjectReaderTests-1763688711 None] Lock "cinder-2049eac9-f776-4cae-80c7-b2ccb19936a2-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:23 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06" returned: 0 in 0.481s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:23 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808" returned: 0 in 0.295s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.417s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488039584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea85e42-f714-4a2d-bf06-98393d3979bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:22Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume 9ea85e42-f714-4a2d-bf06-98393d3979bc {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:23 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:23 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06 Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:23 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:23 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc 1073741824 Jul 22 02:09:23 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bdb298-e5c1-4cfb-93e0-ed9ec5b5175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608e6e72-7059-4a0b-a859-6149bb8d407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 (3a295289-b8f8-42ca-a6dd-8f0b92f30808): created successfully Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608e6e72-7059-4a0b-a859-6149bb8d407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0d1343a1-c203-4d3e-8f73-5a11e13f0f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f9bbc678-1d7a-49b8-be03-f75429372d00 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:24 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-eac11fae-aca8-42e7-b94e-5f5c3d324f06" returned: 0 in 0.475s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-eac11fae-aca8-42e7-b94e-5f5c3d324f06" released by "delete_volume" :: held 1.065s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Created reservations ['dd3a7416-db30-4c3a-8907-599a6ed568fa', 'c8a25ea5-94cf-4d43-a08b-35883b08d01b', '9180e550-52e5-499a-8c53-1f7d72d7faec', 'cc85b20f-19bd-4cf5-ae87-44b16a00eebc'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Flow 'volume_create_manager' (9c04a9da-091c-4484-9c7a-9dd9aba2c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9254617-f991-494a-a637-baaa4dd2d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc 1073741824" returned: 0 in 0.805s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9254617-f991-494a-a637-baaa4dd2d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751184401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b25bbb1-9526-44fc-badd-dcf5dec2cb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0df5bbb68345afb756751b7ad3d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:25Z,use_quota=True,user_id='d8a64d22a4124f109e06505218d9a0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:24 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:24 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4507e618-f5b0-4aa4-bcb2-98bca61aff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4507e618-f5b0-4aa4-bcb2-98bca61aff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c455176-a60e-46ca-a51f-73805df376b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c455176-a60e-46ca-a51f-73805df376b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b25bbb1-9526-44fc-badd-dcf5dec2cb6c', 'volume_name': 'volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb89eb83-586f-4c60-8f0c-224df33c2deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb89eb83-586f-4c60-8f0c-224df33c2deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b278461-da30-4c56-b58b-051151b7acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:24 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Volume 0b25bbb1-9526-44fc-badd-dcf5dec2cb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c', 'volume_size': 1} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:24 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc Jul 22 02:09:24 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:24 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.251s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:24 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:24 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Deleted volume successfully. Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a1a80d3d-beb5-4d77-a50d-dc1a14c60a06 tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-eac11fae-aca8-42e7-b94e-5f5c3d324f06-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:25 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1736632852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb163ba-17df-4ceb-a965-32202d26ff4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:23Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume cbb163ba-17df-4ceb-a965-32202d26ff4b {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:25 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988e890e-5d44-4c19-8c5a-d0714b5fe21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea85e42-f714-4a2d-bf06-98393d3979bc', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afc762-a400-4a37-b1f0-de775aaf41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:25 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b 1073741824 Jul 22 02:09:25 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:25 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-9ea85e42-f714-4a2d-bf06-98393d3979bc (9ea85e42-f714-4a2d-bf06-98393d3979bc): created successfully Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afc762-a400-4a37-b1f0-de775aaf41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (0cbe4ebd-3089-4520-a1eb-3cc53c87d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-975650b6-b8b4-422e-97cb-616da9bbb9eb tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "cinder-quobyte-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" acquired by "delete_volume" :: waited 0.031s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb7b95-3eba-4b94-8fd8-c62c9ad77296]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:25 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf Jul 22 02:09:25 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:25 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b 1073741824" returned: 0 in 0.666s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:25 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b Jul 22 02:09:25 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:25 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" returned: 0 in 0.537s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:26 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf Jul 22 02:09:26 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:26 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b" returned: 0 in 0.294s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1886250482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaeef63-00ae-4ff5-8670-e1ab17c5683f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e6dbd3aca94c3b8ade4f2cffdee7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:23Z,use_quota=True,user_id='9793787af5c74afb97901ce5e307cf40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Creating volume afaeef63-00ae-4ff5-8670-e1ab17c5683f {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:26 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a99c3e-5e71-4244-858a-97393cc8b2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb163ba-17df-4ceb-a965-32202d26ff4b', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa1dfe8-5253-465e-80ea-c68067cdc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:26 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f 1073741824 Jul 22 02:09:26 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:26 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-cbb163ba-17df-4ceb-a965-32202d26ff4b (cbb163ba-17df-4ceb-a965-32202d26ff4b): created successfully Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa1dfe8-5253-465e-80ea-c68067cdc15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (7ae09fee-edf1-4fd8-be75-d225d05fa5da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1e1bf3d8-fdf4-4e9b-80ba-ee39ec831cf8 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:26 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" returned: 0 in 0.288s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-quobyte-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf" released by "delete_volume" :: held 0.892s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Created reservations ['274ab405-91ee-410c-8cbb-47ea6347f023', 'b128b174-8faf-4bfe-acc7-9897d016f30f', '82865c52-87c3-4bff-ae5b-045203420f8e', '29a19452-4e8a-45fa-986f-d3a42897bfa1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:26 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:26 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:26 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f 1073741824" returned: 0 in 0.549s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:26 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.322s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:26 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f Jul 22 02:09:26 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Deleted volume successfully. Jul 22 02:09:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-7d8db5b6-67c2-4baa-8ca7-4e7d1af7f35e tempest-CreateVolumesFromImageTest-1997458686 None] Lock "cinder-6b3fc7a9-a8d9-4e81-9c65-727131fe97cf-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:27 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f" returned: 0 in 0.301s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751184401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b25bbb1-9526-44fc-badd-dcf5dec2cb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0df5bbb68345afb756751b7ad3d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:25Z,use_quota=True,user_id='d8a64d22a4124f109e06505218d9a0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Creating volume 0b25bbb1-9526-44fc-badd-dcf5dec2cb6c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:27 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3324e92-8b24-4922-baa8-4f8ebdeefa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:27 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c 1073741824 Jul 22 02:09:27 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ab84ff-08ed-45b8-bd56-646862868fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Volume volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f (afaeef63-00ae-4ff5-8670-e1ab17c5683f): created successfully Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ab84ff-08ed-45b8-bd56-646862868fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Flow 'volume_create_manager' (beec0121-24f7-415b-9a70-e9c1b760c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8b4bd3ee-c4dc-4b46-91eb-5d22719efcc5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created volume successfully. Jul 22 02:09:27 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c 1073741824" returned: 0 in 0.614s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:27 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c Jul 22 02:09:27 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:28 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" returned: 0 in 0.339s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b278461-da30-4c56-b58b-051151b7acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422c1efc-db6f-401b-95fd-a968c39afb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:28 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Volume volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c (0b25bbb1-9526-44fc-badd-dcf5dec2cb6c): created successfully Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422c1efc-db6f-401b-95fd-a968c39afb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Flow 'volume_create_manager' (9c04a9da-091c-4484-9c7a-9dd9aba2c035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-805e114f-6ae8-435e-94af-1b6f67894381 tempest-ProjectReaderTests-1763688711 None] Created volume successfully. Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-afaeef63-00ae-4ff5-8670-e1ab17c5683f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-afaeef63-00ae-4ff5-8670-e1ab17c5683f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-afaeef63-00ae-4ff5-8670-e1ab17c5683f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-afaeef63-00ae-4ff5-8670-e1ab17c5683f" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabeeb0-4df3-44d8-b878-6b169825812e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:28 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f Jul 22 02:09:28 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:28 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f" returned: 0 in 0.438s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:28 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f Jul 22 02:09:28 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Acquiring lock "cinder-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "cinder-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:29 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-afaeef63-00ae-4ff5-8670-e1ab17c5683f" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-afaeef63-00ae-4ff5-8670-e1ab17c5683f" released by "delete_volume" :: held 0.851s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Acquiring lock "cinder-quobyte-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "cinder-quobyte-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aa41dc-a53c-42ef-887f-f681c75e0d30]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['8dfd6ae9-532a-4c69-9dd5-9018a9325909', '0d50a120-5be7-4bc7-b4f1-36ad2b101cb9', 'db5b9036-5188-451c-b089-67a14466b7a4', 'f874e31d-82c3-448a-8faf-8fd8086f124d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:29 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:29 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-cbb163ba-17df-4ceb-a965-32202d26ff4b-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:29 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c Jul 22 02:09:29 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-cbb163ba-17df-4ceb-a965-32202d26ff4b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-cbb163ba-17df-4ceb-a965-32202d26ff4b" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-cbb163ba-17df-4ceb-a965-32202d26ff4b" acquired by "delete_volume" :: waited 0.026s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6ca0b-9cc7-4cd0-8997-b6d98d782e5a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:29 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" returned: 0 in 0.664s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:29 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b Jul 22 02:09:29 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:29 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c Jul 22 02:09:29 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:29 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.512s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bf8d25af-9838-4ad2-be33-4e57d9bf5101 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-afaeef63-00ae-4ff5-8670-e1ab17c5683f-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:30 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b" returned: 0 in 0.549s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:30 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b Jul 22 02:09:30 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:30 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Flow 'volume_create_manager' (442e7950-093e-49fa-9e9e-6510809639ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be242bf8-38da-4af3-b9a6-393b96a6f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" returned: 0 in 0.519s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be242bf8-38da-4af3-b9a6-393b96a6f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1575799978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fd0a4235654249a51bdd1e547b719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:30Z,use_quota=True,user_id='313e007ffbab424da69ac742d092e2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b4f68-f95e-4b76-b98a-13a81e7fec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b4f68-f95e-4b76-b98a-13a81e7fec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda2373-5d18-4e07-9d45-a9c429b6ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda2373-5d18-4e07-9d45-a9c429b6ff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0', 'volume_name': 'volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1d72f-6295-4ba4-a0cd-08854651496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d1d72f-6295-4ba4-a0cd-08854651496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2391f494-6ba2-47c3-aa31-68105b549a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Volume 719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0', 'volume_size': 1} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1575799978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fd0a4235654249a51bdd1e547b719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:30Z,use_quota=True,user_id='313e007ffbab424da69ac742d092e2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Creating volume 719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:30 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "cinder-quobyte-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c" released by "delete_volume" :: held 1.315s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:30 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 1073741824 Jul 22 02:09:30 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Created reservations ['32b42770-8700-443a-b2f4-87e43879f713', '73540423-a448-4c68-813a-122f0e886499', '95756d75-b725-492e-b419-73e1af69aa93', '31ea9130-29b8-4052-b312-ed978d6f8662'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:30 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cbb163ba-17df-4ceb-a965-32202d26ff4b" returned: 0 in 0.338s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-cbb163ba-17df-4ceb-a965-32202d26ff4b" released by "delete_volume" :: held 0.959s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:30 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:30 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['fdb4ebc3-d7d9-425f-bc74-6a15b257ae6e', '03d24588-449d-4243-8a6a-87de805870a0', '379417ba-5435-41f2-8704-de91995e7012', 'ecd5a956-557b-4411-8518-07e03263edd7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:30 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:30 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:30 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.366s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:30 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:30 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Deleted volume successfully. Jul 22 02:09:30 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 1073741824" returned: 0 in 0.590s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e9d2e2e2-d36c-4326-a50b-76a2531a87da tempest-ProjectReaderTests-1763688711 None] Lock "cinder-0b25bbb1-9526-44fc-badd-dcf5dec2cb6c-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:31 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:31 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:31 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.309s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a6a71a6c-4338-48e2-b1fb-37d0119f52f5 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-cbb163ba-17df-4ceb-a965-32202d26ff4b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:31 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.318s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2391f494-6ba2-47c3-aa31-68105b549a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0beeada-694e-4a6a-a48d-00a23b19dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:31 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Volume volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 (719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0): created successfully Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0beeada-694e-4a6a-a48d-00a23b19dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Flow 'volume_create_manager' (442e7950-093e-49fa-9e9e-6510809639ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-647cf7e7-bd26-4eba-bb00-b5cf9d40de54 tempest-VolumeDependencyTests-1807232417 None] Created volume successfully. Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-9ea85e42-f714-4a2d-bf06-98393d3979bc-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-9ea85e42-f714-4a2d-bf06-98393d3979bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-9ea85e42-f714-4a2d-bf06-98393d3979bc" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-9ea85e42-f714-4a2d-bf06-98393d3979bc" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad804f-3cec-4f66-9385-fcbe6f6ed160]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:32 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc Jul 22 02:09:32 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:32 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc" returned: 0 in 0.491s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:32 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc Jul 22 02:09:32 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Creating offline snapshot 1ed11c83-1032-415d-9940-2ae52f4169f4 of volume 719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdfa521-8e50-44d1-8937-583f88edd5d0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:32 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9ea85e42-f714-4a2d-bf06-98393d3979bc" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-9ea85e42-f714-4a2d-bf06-98393d3979bc" released by "delete_volume" :: held 0.930s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['4bf23a3c-31f7-495a-941b-968881e15985', '8f563261-0816-4473-a423-6a35c5213841', '397f943b-3c1a-4962-a84a-63e2fa7b47e7', '9c1de3a8-1b54-43bb-8e8d-579c4aa88a71'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:32 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:32 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:33 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:33 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:33 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.350s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:33 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.626s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-012e63ba-b918-4492-a77d-c9c3f83c6c7d tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-9ea85e42-f714-4a2d-bf06-98393d3979bc-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:33 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 1G Jul 22 02:09:33 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:33 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 1G" returned: 0 in 0.581s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:33 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:33 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-3a295289-b8f8-42ca-a6dd-8f0b92f30808-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-3a295289-b8f8-42ca-a6dd-8f0b92f30808-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-3a295289-b8f8-42ca-a6dd-8f0b92f30808" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-3a295289-b8f8-42ca-a6dd-8f0b92f30808" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[24466b08-5328-4145-9e50-0124cdc505cb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:34 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.460s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:34 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 is being set with open permissions: ugo+rw Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:34 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:34 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:34 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 Jul 22 02:09:34 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:34 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:34 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info Jul 22 02:09:34 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:34 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808" returned: 0 in 0.537s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:34 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808 Jul 22 02:09:34 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:35 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info" returned: 0 in 0.301s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:35 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info is being set with open permissions: ugo+rw Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:35 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info Jul 22 02:09:35 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:35 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-3a295289-b8f8-42ca-a6dd-8f0b92f30808" returned: 0 in 0.347s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-3a295289-b8f8-42ca-a6dd-8f0b92f30808" released by "delete_volume" :: held 0.940s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['0ea11f9e-6ed2-4a05-ba12-8f1ec5a59e78', 'd3ca01ca-6499-4398-a1ac-a19eb168b98b', '3ca1818b-d83d-4ff3-86de-ae69f249e939', 'd4b86492-569f-4edd-837f-77ef6eebc285'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:35 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.info" returned: 0 in 0.415s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:35 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:35 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.883s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-297b3c1b-7402-4753-a673-0eb439ecd98a tempest-VolumeDependencyTests-1807232417 None] Create snapshot completed successfully Jul 22 02:09:35 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9c7726f0-972c-418c-b980-f6700db33c34 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-3a295289-b8f8-42ca-a6dd-8f0b92f30808-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-9a5819a1-6341-4216-9418-807d562f7850-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-9a5819a1-6341-4216-9418-807d562f7850-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-9a5819a1-6341-4216-9418-807d562f7850" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-9a5819a1-6341-4216-9418-807d562f7850" acquired by "delete_volume" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Flow 'volume_create_manager' (eb0b9186-028e-4c36-9bfd-b9ee61c58ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e2a00-336c-4ec4-8c0d-4d1dcf6666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f6da8-8744-4829-a12c-bbc41a0e1e9c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e2a00-336c-4ec4-8c0d-4d1dcf6666ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2067747098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67502f5-4133-4f30-baf1-49309a14e519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55fd0a4235654249a51bdd1e547b719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ed11c83-1032-415d-9940-2ae52f4169f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:36Z,use_quota=True,user_id='313e007ffbab424da69ac742d092e2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2c5aeb-bda5-4f82-a456-1db18bb2b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2c5aeb-bda5-4f82-a456-1db18bb2b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715cc8c3-3a7a-4bb6-853a-c67df24ed930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715cc8c3-3a7a-4bb6-853a-c67df24ed930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c67502f5-4133-4f30-baf1-49309a14e519', 'volume_name': 'volume-c67502f5-4133-4f30-baf1-49309a14e519', 'volume_size': 1, 'snapshot_id': '1ed11c83-1032-415d-9940-2ae52f4169f4'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8394a0c2-92fd-4c0b-bc83-e3f368634a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8394a0c2-92fd-4c0b-bc83-e3f368634a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13533c7-ef89-4991-8e6c-ea7a438dc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Volume c67502f5-4133-4f30-baf1-49309a14e519: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c67502f5-4133-4f30-baf1-49309a14e519', 'volume_size': 1, 'snapshot_id': '1ed11c83-1032-415d-9940-2ae52f4169f4'} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4-c67502f5-4133-4f30-baf1-49309a14e519" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4-c67502f5-4133-4f30-baf1-49309a14e519" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Creating volume c67502f5-4133-4f30-baf1-49309a14e519 from snapshot 1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] snapshot: 1ed11c83-1032-415d-9940-2ae52f4169f4, volume: c67502f5-4133-4f30-baf1-49309a14e519, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:09:36 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 Jul 22 02:09:36 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[69854dc8-1287-410e-ba20-4266c23f15c2]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:36 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:36 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:37 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850" returned: 0 in 0.483s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:37 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850 Jul 22 02:09:37 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:37 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.472s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9069613e-41cb-45bf-976a-93e69a9e77be]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:37 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:37 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:37 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (ab9d59b4-653f-4500-acb7-9404e0f71522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d61eb1-cd2f-467b-a7b3-22f3495d2385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9a5819a1-6341-4216-9418-807d562f7850" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d61eb1-cd2f-467b-a7b3-22f3495d2385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419631808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ad1ff5-345b-41cd-b096-070772e1c10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:37Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd7d55d-b8c4-46d7-9ec8-b87477b15538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd7d55d-b8c4-46d7-9ec8-b87477b15538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d3c300-2c6f-497e-8e0a-0141de7d985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d3c300-2c6f-497e-8e0a-0141de7d985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ad1ff5-345b-41cd-b096-070772e1c10d', 'volume_name': 'volume-e5ad1ff5-345b-41cd-b096-070772e1c10d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ff7cd7-affc-44ab-bf6b-ec96a3f0b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ff7cd7-affc-44ab-bf6b-ec96a3f0b763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768fec7-0953-4803-bdf2-f6173640ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:37 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Volume e5ad1ff5-345b-41cd-b096-070772e1c10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ad1ff5-345b-41cd-b096-070772e1c10d', 'volume_size': 1} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-9a5819a1-6341-4216-9418-807d562f7850" released by "delete_volume" :: held 1.022s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['7f8a12e7-ef82-4d93-be2c-2005863fe48e', '96b74467-1f43-42b6-9e5b-c7f5aa1e55d0', '745195e4-7910-4af5-b58d-3625e36abc59', 'ba8f4ad3-62d8-4540-825f-86b37f9dee84'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:37 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:37 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:37 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.457s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:09:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:37 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 Jul 22 02:09:37 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:38 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:38 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:38 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-f69356d8-6434-4f1e-97c0-983cb01ca624 tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-9a5819a1-6341-4216-9418-807d562f7850-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-6085ed41-3db0-4aae-bde9-f69170ad5b48-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-6085ed41-3db0-4aae-bde9-f69170ad5b48-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "cinder-quobyte-6085ed41-3db0-4aae-bde9-f69170ad5b48" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-6085ed41-3db0-4aae-bde9-f69170ad5b48" acquired by "delete_volume" :: waited 0.038s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b419e-6654-4a73-be4f-6994ed04ec98]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:39 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 Jul 22 02:09:39 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:40 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48" returned: 0 in 0.880s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:40 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48 Jul 22 02:09:40 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:40 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-6085ed41-3db0-4aae-bde9-f69170ad5b48" returned: 0 in 0.509s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:40 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-quobyte-6085ed41-3db0-4aae-bde9-f69170ad5b48" released by "delete_volume" :: held 1.488s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:40 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Created reservations ['18baad39-5b33-441f-95b2-21a27dd7eb5e', '61b5aa6e-5ccb-4e6e-ac5b-acad2f4607f6', 'd05acf7f-65c1-4cba-a79f-22e332a1072a', '4fe47d4c-8519-4150-9f7b-23d1c5d19814'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:41 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:41 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:42 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.971s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:42 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Deleted volume successfully. Jul 22 02:09:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d58ec567-4db4-436a-afc7-f401c28bc71f tempest-CreateVolumesFromSourceVolumeTest-791546681 None] Lock "cinder-6085ed41-3db0-4aae-bde9-f69170ad5b48-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:44 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519" returned: 0 in 6.201s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b305aa8-7c15-4672-80e9-9fda1bf3c443]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:44 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:44 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:44 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.651s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:09:44 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Converted 1024.00 MB image at 165.10 MB/s Jul 22 02:09:44 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 is being set with open permissions: ugo+rw Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:44 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 Jul 22 02:09:44 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:44 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519" returned: 0 in 0.287s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" released by "_copy_volume_from_snapshot" :: held 8.206s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4-c67502f5-4133-4f30-baf1-49309a14e519" released by "_create_volume_from_snapshot" :: held 8.247s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.266s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.383s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419631808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ad1ff5-345b-41cd-b096-070772e1c10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:37Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Creating volume e5ad1ff5-345b-41cd-b096-070772e1c10d {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:45 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=179,cinder:UPDATE=239,cinder:INSERT=64,cinder:DELETE=26 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:09:45 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d 1073741824 Jul 22 02:09:45 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=256,cinder:SELECT=175,cinder:INSERT=67,cinder:DELETE=19 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13533c7-ef89-4991-8e6c-ea7a438dc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67502f5-4133-4f30-baf1-49309a14e519', 'volume_size': 1, 'snapshot_id': '1ed11c83-1032-415d-9940-2ae52f4169f4'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcacfbed-32e2-40e0-8c3e-922ef841f713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:45 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Volume volume-c67502f5-4133-4f30-baf1-49309a14e519 (c67502f5-4133-4f30-baf1-49309a14e519): created successfully Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcacfbed-32e2-40e0-8c3e-922ef841f713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Flow 'volume_create_manager' (eb0b9186-028e-4c36-9bfd-b9ee61c58ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-bebd9abe-b21a-41dd-9cd2-be8b431cd1f8 tempest-VolumeDependencyTests-1807232417 None] Created volume successfully. Jul 22 02:09:45 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d 1073741824" returned: 0 in 0.643s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-1ed11c83-1032-415d-9940-2ae52f4169f4-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-1ed11c83-1032-415d-9940-2ae52f4169f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:45 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d Jul 22 02:09:45 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Deleting offline snapshot 1ed11c83-1032-415d-9940-2ae52f4169f4 of volume 719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] snapshot_file for this snap is: volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c348aa-2fe6-48e8-9fd4-8bd51ba8d8db]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:45 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:45 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:46 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d" returned: 0 in 0.330s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d768fec7-0953-4803-bdf2-f6173640ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ad1ff5-345b-41cd-b096-070772e1c10d', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558e7cfe-be2c-401c-a0fe-5f1c2beb95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:46 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Volume volume-e5ad1ff5-345b-41cd-b096-070772e1c10d (e5ad1ff5-345b-41cd-b096-070772e1c10d): created successfully Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558e7cfe-be2c-401c-a0fe-5f1c2beb95c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (ab9d59b4-653f-4500-acb7-9404e0f71522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:46 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-16f921c4-4dfe-43f8-b59e-5eee72bb6a7f tempest-ProjectReaderTests-4435146 None] Created volume successfully. Jul 22 02:09:46 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.455s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[806e2776-778c-4057-9d5a-a6bc9232a40f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:46 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:46 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:46 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.522s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:46 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:46 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-e5ad1ff5-345b-41cd-b096-070772e1c10d-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "cinder-e5ad1ff5-345b-41cd-b096-070772e1c10d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:46 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Flow 'volume_create_manager' (82122106-cfd9-4ad7-a379-ad488db8e9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ddc49b-a1d3-4209-95be-4ff9c00538e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ddc49b-a1d3-4209-95be-4ff9c00538e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03291f63-c3ef-494f-883d-f5f355fa3e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418aa8665a334572894203faa55f276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:47Z,use_quota=True,user_id='a96f9530eea14551b341fe6dd1abc367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342c3831-e25c-487f-85d4-8794269cc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342c3831-e25c-487f-85d4-8794269cc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cae14df-5e5a-481e-9c9a-7ff41f3120de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cae14df-5e5a-481e-9c9a-7ff41f3120de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03291f63-c3ef-494f-883d-f5f355fa3e78', 'volume_name': 'volume-03291f63-c3ef-494f-883d-f5f355fa3e78', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8947b0f9-763b-469f-af45-2ecacf39e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8947b0f9-763b-469f-af45-2ecacf39e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9165a01-3daf-42dc-82ca-fa813d37d4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:47 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Volume 03291f63-c3ef-494f-883d-f5f355fa3e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03291f63-c3ef-494f-883d-f5f355fa3e78', 'volume_size': 1} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03291f63-c3ef-494f-883d-f5f355fa3e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418aa8665a334572894203faa55f276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:47Z,use_quota=True,user_id='a96f9530eea14551b341fe6dd1abc367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Creating volume 03291f63-c3ef-494f-883d-f5f355fa3e78 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:47 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-quobyte-e5ad1ff5-345b-41cd-b096-070772e1c10d" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:47 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 1073741824 Jul 22 02:09:47 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-e5ad1ff5-345b-41cd-b096-070772e1c10d" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3e7468-7a18-4cb4-a32b-28c547a15e8e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:47 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d Jul 22 02:09:47 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:47 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.548s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:47 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4 Jul 22 02:09:47 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:47 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d" returned: 0 in 0.421s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:47 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 1073741824" returned: 0 in 0.531s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d Jul 22 02:09:47 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:47 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 Jul 22 02:09:47 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:47 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0.1ed11c83-1032-415d-9940-2ae52f4169f4" returned: 0 in 0.322s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-1ed11c83-1032-415d-9940-2ae52f4169f4" released by "_delete_snapshot" :: held 1.998s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" released by "delete_snapshot" :: held 2.047s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Created reservations ['866a5cce-5838-44fb-aa93-cd5337c99de8', 'e84b3113-7fb8-48c6-a66f-5afe1da73528', 'f6221519-7055-410e-bacb-e5411fa2129d', 'b78b0386-e4ab-492e-8e45-35710431689a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:47 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e5ad1ff5-345b-41cd-b096-070772e1c10d" returned: 0 in 0.344s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78" returned: 0 in 0.308s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-e5ad1ff5-345b-41cd-b096-070772e1c10d" released by "delete_volume" :: held 0.836s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9165a01-3daf-42dc-82ca-fa813d37d4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03291f63-c3ef-494f-883d-f5f355fa3e78', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a151ec6c-693b-4d7b-9880-e0c947d1c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Volume volume-03291f63-c3ef-494f-883d-f5f355fa3e78 (03291f63-c3ef-494f-883d-f5f355fa3e78): created successfully Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a151ec6c-693b-4d7b-9880-e0c947d1c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Flow 'volume_create_manager' (82122106-cfd9-4ad7-a379-ad488db8e9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2edce53f-0c9e-497e-a252-26120c8fa7cd tempest-CinderUnicodeTest-282319845 None] Created volume successfully. Jul 22 02:09:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Delete snapshot completed successfully. Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Created reservations ['21a48855-5f16-45e0-9e86-f7c47d924c92', '84a7aac3-a737-48a3-9d74-bcc9e8b14af0', 'f5031c16-3296-48e1-b60c-587b25381225', '7e57cf43-9090-4709-94f2-5a552e0e101a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2f5e928c-022a-40d1-94a6-e907dc9471d5 tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-1ed11c83-1032-415d-9940-2ae52f4169f4-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:48 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:48 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:48 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Deleted volume successfully. Jul 22 02:09:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4fe0ecad-e902-4c4f-828d-61de400decbd tempest-ProjectReaderTests-4435146 None] Lock "cinder-e5ad1ff5-345b-41cd-b096-070772e1c10d-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" acquired by "delete_volume" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[efda8287-eb78-40fb-9145-61d2aa864d0a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:49 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:49 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:49 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.563s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:49 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0 Jul 22 02:09:49 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:49 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Flow 'volume_create_manager' (33e88583-c595-4aed-9e6b-12136fe028c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db06d8e9-dcb5-422c-9e01-1c0072db613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db06d8e9-dcb5-422c-9e01-1c0072db613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1303789467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa484e9-d4dd-4320-ba55-e79a2178f2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418aa8665a334572894203faa55f276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:50Z,use_quota=True,user_id='a96f9530eea14551b341fe6dd1abc367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0aba37-d929-46ea-8390-d3afba856f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0aba37-d929-46ea-8390-d3afba856f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc6823c-d9f0-4b60-9a15-f78882b88ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc6823c-d9f0-4b60-9a15-f78882b88ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa484e9-d4dd-4320-ba55-e79a2178f2a0', 'volume_name': 'volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a22956f-be76-480f-968e-b4792cb08c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a22956f-be76-480f-968e-b4792cb08c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbd6795-c5bb-4ca5-8540-716448228914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Volume 8fa484e9-d4dd-4320-ba55-e79a2178f2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0', 'volume_size': 1} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1303789467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa484e9-d4dd-4320-ba55-e79a2178f2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418aa8665a334572894203faa55f276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:50Z,use_quota=True,user_id='a96f9530eea14551b341fe6dd1abc367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Creating volume 8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:50 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:50 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 1073741824 Jul 22 02:09:50 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (914ed882-f727-4b0b-b2c1-03d936c71428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08201b4d-50da-4f79-a1f4-557ce5ab3820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08201b4d-50da-4f79-a1f4-557ce5ab3820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360986316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297dfb33-40fd-4910-ab2a-54adb210d4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:50Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0963654-982f-450b-b544-7641052d2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0963654-982f-450b-b544-7641052d2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fd0e0e-27f6-478e-8ba6-38009cf0e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fd0e0e-27f6-478e-8ba6-38009cf0e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '297dfb33-40fd-4910-ab2a-54adb210d4e9', 'volume_name': 'volume-297dfb33-40fd-4910-ab2a-54adb210d4e9', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8ff44-ccbb-4f28-9ead-f34cf4c70ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8ff44-ccbb-4f28-9ead-f34cf4c70ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aed89cd-5805-4f1b-9907-2627506ea706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Volume 297dfb33-40fd-4910-ab2a-54adb210d4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-297dfb33-40fd-4910-ab2a-54adb210d4e9', 'volume_size': 1} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:50 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" returned: 0 in 0.541s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0" released by "delete_volume" :: held 1.200s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Created reservations ['5089efd6-cdea-450b-a215-c951eb5312f8', '87066783-463d-4daa-891b-ae555ed11454', '11531d05-efa6-4167-bba4-e29d849d7a82', 'b8f3a682-5918-4b7c-9061-1e7915ec8c88'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:50 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:50 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:50 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 1073741824" returned: 0 in 0.619s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:50 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 Jul 22 02:09:50 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:50 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Flow 'volume_create_manager' (1149c6ae-9c28-4a3c-a764-ed186af9d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eebcc5a-8010-4efd-b9ad-104a8f6aa84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Deleted volume successfully. Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eebcc5a-8010-4efd-b9ad-104a8f6aa84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2035466510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189d340a74e2493cb52f190c57534887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:51Z,use_quota=True,user_id='def92fdcadec43298cf437f8cdf4d61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27f48ee-a1cd-454d-b84b-18276bebd328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27f48ee-a1cd-454d-b84b-18276bebd328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178ae65d-f833-48d1-bdc9-7b607abe1492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178ae65d-f833-48d1-bdc9-7b607abe1492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0', 'volume_name': 'volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5db6b1-930f-4ade-bb2f-8c5cbadfa6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5db6b1-930f-4ade-bb2f-8c5cbadfa6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bc6b32-aebc-48c3-839a-8854c215e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Volume 53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0', 'volume_size': 1} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:50 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e7b5a240-bee5-4d17-8b5e-e6e444aa23df tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-719fa9e3-fdf6-4a6c-96e6-dfeb1b1497b0-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:51 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" returned: 0 in 0.280s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360986316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297dfb33-40fd-4910-ab2a-54adb210d4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:50Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Creating volume 297dfb33-40fd-4910-ab2a-54adb210d4e9 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbd6795-c5bb-4ca5-8540-716448228914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4627db2-1a6c-4980-b4af-1f15cd8e2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:51 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 1073741824 Jul 22 02:09:51 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Volume volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 (8fa484e9-d4dd-4320-ba55-e79a2178f2a0): created successfully Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4627db2-1a6c-4980-b4af-1f15cd8e2469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Flow 'volume_create_manager' (33e88583-c595-4aed-9e6b-12136fe028c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1d12b05b-1924-45d7-9a65-5a5ba96ce934 tempest-CinderUnicodeTest-282319845 None] Created volume successfully. Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-c67502f5-4133-4f30-baf1-49309a14e519-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-c67502f5-4133-4f30-baf1-49309a14e519-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58cfb49-e0cd-4560-a7fd-7fe840f55d0c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:51 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 1073741824" returned: 0 in 0.534s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:51 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 Jul 22 02:09:51 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:51 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 Jul 22 02:09:51 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:51 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2035466510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189d340a74e2493cb52f190c57534887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:51Z,use_quota=True,user_id='def92fdcadec43298cf437f8cdf4d61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Creating volume 53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aed89cd-5805-4f1b-9907-2627506ea706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297dfb33-40fd-4910-ab2a-54adb210d4e9', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:51 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:51 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 1073741824 Jul 22 02:09:51 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b2ace1-9aef-41df-b242-0db59383a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Volume volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 (297dfb33-40fd-4910-ab2a-54adb210d4e9): created successfully Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b2ace1-9aef-41df-b242-0db59383a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:51 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519 Jul 22 02:09:51 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (914ed882-f727-4b0b-b2c1-03d936c71428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-3c5d265d-9928-4200-8d4c-8b5df52b3060 tempest-ProjectReaderTests-4435146 None] Created volume successfully. Jul 22 02:09:52 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c67502f5-4133-4f30-baf1-49309a14e519" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-quobyte-c67502f5-4133-4f30-baf1-49309a14e519" released by "delete_volume" :: held 0.697s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Created reservations ['a17deda2-b964-47f5-82c7-2f8721d11092', '591bb284-9626-4246-b9f0-af093150ae6b', '50ea1b4a-ac87-4753-9c7e-0141c9ef1fdf', '2fc2e757-1bf5-4303-917b-fbe114af511b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:52 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 1073741824" returned: 0 in 0.452s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:52 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:52 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:52 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:09:52 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:52 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:52 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-297dfb33-40fd-4910-ab2a-54adb210d4e9-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "cinder-297dfb33-40fd-4910-ab2a-54adb210d4e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-quobyte-297dfb33-40fd-4910-ab2a-54adb210d4e9" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:52 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.331s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:52 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.150s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.413s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-297dfb33-40fd-4910-ab2a-54adb210d4e9" acquired by "delete_volume" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Deleted volume successfully. Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bc6b32-aebc-48c3-839a-8854c215e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff4a6e-ff5d-49be-a0b1-e9ebdd5e4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2358d8-7500-47df-9ae5-a246087262f1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Creating offline snapshot bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff of volume 8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a897a6-fe97-42f0-a6f1-c66ee4026421]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:52 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:52 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Volume volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 (53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0): created successfully Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff4a6e-ff5d-49be-a0b1-e9ebdd5e4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Flow 'volume_create_manager' (1149c6ae-9c28-4a3c-a764-ed186af9d721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.469s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-67b930cd-d682-4df1-bb66-7f98775ad1fd tempest-VolumeDependencyTests-1807232417 None] Lock "cinder-c67502f5-4133-4f30-baf1-49309a14e519-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:09:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:09:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1e7bf32a-8f06-4ccd-b1b6-a241d3d8c861 tempest-SnapshotDependencyTests-1785163805 None] Created volume successfully. Jul 22 02:09:53 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 Jul 22 02:09:53 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:53 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 Jul 22 02:09:53 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:53 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9" returned: 0 in 0.448s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:53 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:53 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9 Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" returned: 0 in 0.428s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:53 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:53 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff 1G Jul 22 02:09:53 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:53 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-297dfb33-40fd-4910-ab2a-54adb210d4e9" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-297dfb33-40fd-4910-ab2a-54adb210d4e9" released by "delete_volume" :: held 0.777s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Created reservations ['6c55b859-92e2-45dc-9b95-bee6175298c4', '28c5166e-674e-4d61-a59b-ac3191a80f0c', '1150afd9-929c-40c6-a4b4-b037be624c86', 'd0272bc8-b3d2-4428-8c0d-54ecf2214bb8'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:53 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:53 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:53 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff 1G" returned: 0 in 0.484s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:53 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff Jul 22 02:09:53 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:54 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.342s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Deleted volume successfully. Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-14fb7127-4843-4816-8e0d-edd8d435f2ec tempest-ProjectReaderTests-4435146 None] Lock "cinder-297dfb33-40fd-4910-ab2a-54adb210d4e9-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:54 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" returned: 0 in 0.425s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:54 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff is being set with open permissions: ugo+rw Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:54 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff Jul 22 02:09:54 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:54 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" returned: 0 in 0.332s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (c2a565cf-4a65-49d3-a1a9-8b3a50a42789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e8224-9a54-46de-8329-94d283995328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e8224-9a54-46de-8329-94d283995328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219692458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c90768-dfa2-41ce-808b-40bc0dccad52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:55Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bcfe20-f57b-4baf-83c1-fbc53bc5d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bcfe20-f57b-4baf-83c1-fbc53bc5d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049d65f5-075b-45e3-8771-72a93860fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049d65f5-075b-45e3-8771-72a93860fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c90768-dfa2-41ce-808b-40bc0dccad52', 'volume_name': 'volume-f4c90768-dfa2-41ce-808b-40bc0dccad52', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf14e8f6-92a6-466c-a960-a76c62739f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf14e8f6-92a6-466c-a960-a76c62739f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5a5a0-aa46-4c07-bb97-e362bff6c916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:54 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Volume f4c90768-dfa2-41ce-808b-40bc0dccad52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c90768-dfa2-41ce-808b-40bc0dccad52', 'volume_size': 1} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:54 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info Jul 22 02:09:54 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:54 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:54 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info is being set with open permissions: ugo+rw Jul 22 02:09:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:54 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info Jul 22 02:09:54 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:55 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.info" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Creating offline snapshot d9aabed1-122e-4323-b800-9974c5c1cc25 of volume 53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:09:55 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e9d65618-1c31-46bc-a1c1-0ed082a4e155 tempest-CinderUnicodeTest-282319845 None] Create snapshot completed successfully Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f518bb9-77aa-40d4-9f29-ffd4021a1b12]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:55 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:09:55 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:55 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:55 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 1G Jul 22 02:09:55 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-quobyte-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Deleting offline snapshot bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff of volume 8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] snapshot_file for this snap is: volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1027f-cf55-4dc2-a9f4-86aff5d8cd91]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff Jul 22 02:09:56 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:56 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 1G" returned: 0 in 0.491s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:09:56 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:56 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26cedf6-b6df-4ae6-ab2a-94d90ea99338]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:56 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 is being set with open permissions: ugo+rw Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:09:56 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:56 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 Jul 22 02:09:56 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:56 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.273s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" returned: 0 in 0.391s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:56 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info Jul 22 02:09:56 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:56 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff Jul 22 02:09:56 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:57 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info" returned: 0 in 0.286s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:57 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info is being set with open permissions: ugo+rw Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:57 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info Jul 22 02:09:57 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:57 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" returned: 0 in 0.372s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:57 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff Jul 22 02:09:57 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:57 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.info" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.734s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219692458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c90768-dfa2-41ce-808b-40bc0dccad52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:55Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Creating volume f4c90768-dfa2-41ce-808b-40bc0dccad52 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:57 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:57 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 1073741824 Jul 22 02:09:57 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cf2bb73a-03af-4f18-9940-790491a0d08a tempest-SnapshotDependencyTests-1785163805 None] Create snapshot completed successfully Jul 22 02:09:57 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0.bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" returned: 0 in 0.282s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff" released by "_delete_snapshot" :: held 1.601s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" released by "delete_snapshot" :: held 1.637s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Created reservations ['22321e98-a5e2-4138-a08d-cb093dd00d5f', '6b571baf-1aea-43d5-9489-9d596de4420c', '445df36f-df07-425a-808f-b9ce16d0dad7', '774ecc1d-c499-407a-bb34-6ddb8fa959fb'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Delete snapshot completed successfully. Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-4303dcb8-6912-4b8b-91fe-463164a64e64 tempest-CinderUnicodeTest-282319845 None] Lock "cinder-bdd93284-4b7c-4b54-a3f1-377d3f6bb4ff-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:57 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 1073741824" returned: 0 in 0.524s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:57 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 Jul 22 02:09:57 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-8fa484e9-d4dd-4320-ba55-e79a2178f2a0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "cinder-8fa484e9-d4dd-4320-ba55-e79a2178f2a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[061a9524-a880-4249-9c98-42605d2ed153]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:58 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52" returned: 0 in 0.349s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5a5a0-aa46-4c07-bb97-e362bff6c916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c90768-dfa2-41ce-808b-40bc0dccad52', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa799db0-e0aa-4ad7-a83a-6cd191b2d62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:09:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Volume volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 (f4c90768-dfa2-41ce-808b-40bc0dccad52): created successfully Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa799db0-e0aa-4ad7-a83a-6cd191b2d62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (c2a565cf-4a65-49d3-a1a9-8b3a50a42789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Flow 'volume_create_manager' (20898e85-15dc-40d4-ba47-cdea84f47c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:09:58 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b535d7-0c96-4679-a6b2-68fb1dcb0984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b535d7-0c96-4679-a6b2-68fb1dcb0984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d512da7b-660c-4d00-92c5-f1a33428442a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='189d340a74e2493cb52f190c57534887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9aabed1-122e-4323-b800-9974c5c1cc25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:09:58Z,use_quota=True,user_id='def92fdcadec43298cf437f8cdf4d61c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd215a69-a706-406b-9960-0e053a3fbda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd215a69-a706-406b-9960-0e053a3fbda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f510bc7-b38b-496d-863f-d2d4af2b5215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f510bc7-b38b-496d-863f-d2d4af2b5215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd512da7b-660c-4d00-92c5-f1a33428442a', 'volume_name': 'volume-d512da7b-660c-4d00-92c5-f1a33428442a', 'volume_size': 1, 'snapshot_id': 'd9aabed1-122e-4323-b800-9974c5c1cc25'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9123360-7041-4b4f-8628-aac8ab0ccf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9123360-7041-4b4f-8628-aac8ab0ccf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46d9201-ab99-4c11-8c9a-3797810e7a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:09:58 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Volume d512da7b-660c-4d00-92c5-f1a33428442a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d512da7b-660c-4d00-92c5-f1a33428442a', 'volume_size': 1, 'snapshot_id': 'd9aabed1-122e-4323-b800-9974c5c1cc25'} Jul 22 02:09:58 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-176b4be8-0e45-40ae-8a01-c7930b74ce33 tempest-ProjectReaderTests-4435146 None] Created volume successfully. Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25-d512da7b-660c-4d00-92c5-f1a33428442a" by "_create_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25-d512da7b-660c-4d00-92c5-f1a33428442a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Creating volume d512da7b-660c-4d00-92c5-f1a33428442a from snapshot d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" by "_copy_volume_from_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] snapshot: d9aabed1-122e-4323-b800-9974c5c1cc25, volume: d512da7b-660c-4d00-92c5-f1a33428442a, {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6d0bd7-fcd9-4936-afe6-c0fac2bfc1b1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:58 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" returned: 0 in 0.521s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:58 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:09:58 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-f4c90768-dfa2-41ce-808b-40bc0dccad52-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0 Jul 22 02:09:58 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "cinder-f4c90768-dfa2-41ce-808b-40bc0dccad52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-quobyte-f4c90768-dfa2-41ce-808b-40bc0dccad52" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-f4c90768-dfa2-41ce-808b-40bc0dccad52" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[8181e1bd-244b-4b4f-b21c-28914e619525]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.462s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Creating direct copy from snapshot {{(pid=87153) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d19bec-4168-4415-badc-975c04dd5851]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" returned: 0 in 0.399s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-8fa484e9-d4dd-4320-ba55-e79a2178f2a0" released by "delete_volume" :: held 1.018s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:59 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:09:59 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Created reservations ['c108b02d-3f47-41e7-9e2b-90c33c281b2a', 'a61e2810-63d9-4abc-b721-689d779ea793', '67c90511-2078-4048-9803-413d2c599eb3', '51c3707a-bb65-4e02-ac08-38671c1158d1'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:59 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:59 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52" returned: 0 in 0.514s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52 Jul 22 02:09:59 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:59 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.451s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.utils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Path /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a not found in is_blk_device check {{(pid=87153) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a Jul 22 02:09:59 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:09:59 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.292s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:09:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Deleted volume successfully. Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-c05eca11-684e-42c1-9c2f-78b910def21f tempest-CinderUnicodeTest-282319845 None] Lock "cinder-8fa484e9-d4dd-4320-ba55-e79a2178f2a0-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:59 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f4c90768-dfa2-41ce-808b-40bc0dccad52" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-f4c90768-dfa2-41ce-808b-40bc0dccad52" released by "delete_volume" :: held 0.848s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Created reservations ['72078b13-ab16-4467-b9bf-c9e10204c123', 'f6a20b8a-682e-433d-99c7-368e94a97b25', '5cde7e52-fe6c-47cc-83ca-e2f7c61d8000', 'a095f1fb-0798-4fd3-aebe-deaecc60e314'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:09:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:09:59 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:09:59 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:00 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.318s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Deleted volume successfully. Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-458e5b26-cbb3-4ad4-a2a4-b986ac5cc082 tempest-ProjectReaderTests-4435146 None] Lock "cinder-f4c90768-dfa2-41ce-808b-40bc0dccad52-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-03291f63-c3ef-494f-883d-f5f355fa3e78-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "cinder-03291f63-c3ef-494f-883d-f5f355fa3e78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Acquiring lock "cinder-quobyte-03291f63-c3ef-494f-883d-f5f355fa3e78" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-03291f63-c3ef-494f-883d-f5f355fa3e78" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2140340a-71ee-479f-b0b2-34add52a8528]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:01 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 Jul 22 02:10:01 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (9c9712c3-74ab-497a-be46-1cc2a5289b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa7828c-7bd3-4861-80ee-79fb42c8948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa7828c-7bd3-4861-80ee-79fb42c8948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653807625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e84396d-7d24-4d00-b9c9-337fd48d52c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:01Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de543d4-2e6d-4b06-a45d-7a365513cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de543d4-2e6d-4b06-a45d-7a365513cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa110d8-9295-426f-95b3-cd231c2c3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa110d8-9295-426f-95b3-cd231c2c3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e84396d-7d24-4d00-b9c9-337fd48d52c4', 'volume_name': 'volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5298ed07-7111-4c00-93ea-63661c58c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5298ed07-7111-4c00-93ea-63661c58c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a47fc-fb13-4500-8dfe-a1a123997cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:01 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Volume 9e84396d-7d24-4d00-b9c9-337fd48d52c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4', 'volume_size': 1} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:01 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78" returned: 0 in 0.609s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:01 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78 Jul 22 02:10:01 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:02 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-03291f63-c3ef-494f-883d-f5f355fa3e78" returned: 0 in 0.548s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "cinder-quobyte-03291f63-c3ef-494f-883d-f5f355fa3e78" released by "delete_volume" :: held 1.302s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Created reservations ['30eb8b1a-9507-4f71-8411-fbc72f52c06c', '578c7e41-8aae-4d55-a1ca-359b6f17aec4', '59148eb7-c3cb-4e50-be51-44d83fdf4fe0', 'b1e29fc1-7fb4-4610-989c-6ccd5391da8e'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:02 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:02 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:03 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.971s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:03 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:03 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Deleted volume successfully. Jul 22 02:10:03 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-965c7a17-207f-47ce-9c45-ec41872830db tempest-CinderUnicodeTest-282319845 None] Lock "cinder-03291f63-c3ef-494f-883d-f5f355fa3e78-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:05 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a" returned: 0 in 5.775s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c974b2-a7f3-4894-bbbb-92a95004f31b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:05 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:10:05 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:06 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.634s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.image.image_utils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Image conversion details: src /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a {{(pid=87153) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 22 02:10:06 devstack cinder-volume[87153]: INFO cinder.image.image_utils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Converted 1024.00 MB image at 177.27 MB/s Jul 22 02:10:06 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a is being set with open permissions: ugo+rw Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:06 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a Jul 22 02:10:06 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:06 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" released by "_copy_volume_from_snapshot" :: held 7.701s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25-d512da7b-660c-4d00-92c5-f1a33428442a" released by "_create_volume_from_snapshot" :: held 7.741s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.762s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.902s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653807625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e84396d-7d24-4d00-b9c9-337fd48d52c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f250a3b393240b68070efddcc6c71e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:01Z,use_quota=True,user_id='c13d0388aae646cc9b4bd9ef23f98ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Creating volume 9e84396d-7d24-4d00-b9c9-337fd48d52c4 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:06 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 1073741824 Jul 22 02:10:06 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46d9201-ab99-4c11-8c9a-3797810e7a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d512da7b-660c-4d00-92c5-f1a33428442a', 'volume_size': 1, 'snapshot_id': 'd9aabed1-122e-4323-b800-9974c5c1cc25'}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d2d705-66f7-435d-8079-df1cb74789db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Volume volume-d512da7b-660c-4d00-92c5-f1a33428442a (d512da7b-660c-4d00-92c5-f1a33428442a): created successfully Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d2d705-66f7-435d-8079-df1cb74789db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Flow 'volume_create_manager' (20898e85-15dc-40d4-ba47-cdea84f47c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1fb46fb3-127c-4399-ad2b-9de7650400fd tempest-SnapshotDependencyTests-1785163805 None] Created volume successfully. Jul 22 02:10:06 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 1073741824" returned: 0 in 0.561s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:06 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 Jul 22 02:10:06 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:07 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4" returned: 0 in 0.321s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a47fc-fb13-4500-8dfe-a1a123997cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccea88a-6ded-4355-86ad-9ed19d324d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-d9aabed1-122e-4323-b800-9974c5c1cc25-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Volume volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 (9e84396d-7d24-4d00-b9c9-337fd48d52c4): created successfully Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccea88a-6ded-4355-86ad-9ed19d324d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Flow 'volume_create_manager' (9c9712c3-74ab-497a-be46-1cc2a5289b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-d9aabed1-122e-4323-b800-9974c5c1cc25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8a5a50c8-0e11-48c9-810e-d892105e02fb tempest-ProjectReaderTests-4435146 None] Created volume successfully. Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Deleting offline snapshot d9aabed1-122e-4323-b800-9974c5c1cc25 of volume 53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] snapshot_file for this snap is: volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8bd080-9db3-48db-b9ac-bcad71fe3466]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:07 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:10:07 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-9e84396d-7d24-4d00-b9c9-337fd48d52c4-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "cinder-9e84396d-7d24-4d00-b9c9-337fd48d52c4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Acquiring lock "cinder-quobyte-9e84396d-7d24-4d00-b9c9-337fd48d52c4" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-9e84396d-7d24-4d00-b9c9-337fd48d52c4" acquired by "delete_volume" :: waited 0.027s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b68e1b-6655-40b4-ad8d-b46dcaa91558]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:07 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.498s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ddb884-2584-463e-9871-bc145d02dc2d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:08 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 Jul 22 02:10:08 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:08 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:10:08 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:08 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4" returned: 0 in 0.428s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:08 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4 Jul 22 02:10:08 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:08 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.500s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:08 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:10:08 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:08 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-9e84396d-7d24-4d00-b9c9-337fd48d52c4" returned: 0 in 0.329s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "cinder-quobyte-9e84396d-7d24-4d00-b9c9-337fd48d52c4" released by "delete_volume" :: held 0.819s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (4cd16e04-a232-4fc6-88de-c54714a6f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3113e4-0787-45bf-bb51-4b4452151a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3113e4-0787-45bf-bb51-4b4452151a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-3976735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84c03cc-d992-4a80-8b3f-bb310f0d30c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:09Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf894d5f-284e-4cd6-aa14-242fff434403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf894d5f-284e-4cd6-aa14-242fff434403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae3559f-1fa2-4498-81b8-48c5cca54b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae3559f-1fa2-4498-81b8-48c5cca54b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84c03cc-d992-4a80-8b3f-bb310f0d30c0', 'volume_name': 'volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c707e8-33ad-4ace-8d17-be9f53f4318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c707e8-33ad-4ace-8d17-be9f53f4318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414fb7e5-f732-4b55-8480-2e9e60c816ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:08 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Volume d84c03cc-d992-4a80-8b3f-bb310f0d30c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0', 'volume_size': 1} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-3976735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84c03cc-d992-4a80-8b3f-bb310f0d30c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:09Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Creating volume d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:08 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:08 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 1073741824 Jul 22 02:10:08 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Created reservations ['1d3980b7-a113-4f7d-8cc2-b8c6b4d35ebf', '37411102-3c8d-454b-8fe1-ba9312c9d02e', '19b09250-bd45-4b83-9266-909a3222bfbd', '80d5b86e-a6b2-4622-95ec-ac3007385e6a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:08 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.449s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:09 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25 Jul 22 02:10:09 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:09 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:09 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:09 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0.d9aabed1-122e-4323-b800-9974c5c1cc25" returned: 0 in 0.303s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:09 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d9aabed1-122e-4323-b800-9974c5c1cc25" released by "_delete_snapshot" :: held 1.909s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Deleted volume successfully. Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" released by "delete_snapshot" :: held 1.961s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2c7bea7f-50f3-48fb-a06d-feb2b19104e6 tempest-ProjectReaderTests-4435146 None] Lock "cinder-9e84396d-7d24-4d00-b9c9-337fd48d52c4-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:09 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 1073741824" returned: 0 in 0.547s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Created reservations ['a4561b01-0864-424c-9d1b-3130e599f412', 'dd7566c5-bd56-4f13-ba1a-28f05fa38023', '62a1a7a0-1330-4dd8-92c2-d53d3b9a4983', '74d7b011-5d41-4c29-a04e-817fff0ba96d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:09 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 Jul 22 02:10:09 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Delete snapshot completed successfully. Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-e3443958-6c5d-492a-a049-d62353905906 tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-d9aabed1-122e-4323-b800-9974c5c1cc25-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:09 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" returned: 0 in 0.270s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414fb7e5-f732-4b55-8480-2e9e60c816ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cbcd78-53a0-440c-9308-84f57565215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:09 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Volume volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 (d84c03cc-d992-4a80-8b3f-bb310f0d30c0): created successfully Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cbcd78-53a0-440c-9308-84f57565215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:09 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (4cd16e04-a232-4fc6-88de-c54714a6f335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0610531f-ec2e-4adc-84fc-bfb09e1080b9 tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (a4f614a7-6cb0-448c-ac89-2797622480a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb3969e-9c59-4eb6-b731-0908ee8d4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb3969e-9c59-4eb6-b731-0908ee8d4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039727655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:10Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac3a3d-c7b6-402c-9616-05bfc3a514ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ac3a3d-c7b6-402c-9616-05bfc3a514ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165a9423-e216-4cb4-a6b5-38bab9b7dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165a9423-e216-4cb4-a6b5-38bab9b7dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f', 'volume_name': 'volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17559a3-89aa-48d8-9433-21e957593080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17559a3-89aa-48d8-9433-21e957593080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45694f73-8fa1-4544-a94f-66a10b9303cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:10 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Volume f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f', 'volume_size': 1} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039727655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:10Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Creating volume f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:10 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:10 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f 1073741824 Jul 22 02:10:10 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48bd861-4847-4e66-a487-939f1b67fdd5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:10 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f 1073741824" returned: 0 in 0.536s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:10 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:10:10 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:10 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f Jul 22 02:10:10 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:11 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.464s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:11 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:11 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0 Jul 22 02:10:11 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" returned: 0 in 0.401s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45694f73-8fa1-4544-a94f-66a10b9303cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a56f81-77cc-4303-8db6-506a9ee44f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:11 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Volume volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f (f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f): created successfully Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a56f81-77cc-4303-8db6-506a9ee44f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (a4f614a7-6cb0-448c-ac89-2797622480a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4c774139-a2d7-4e3f-97d1-74ef5a9a428c tempest-ProjectReaderTests-1436522352 None] Created volume successfully. Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Creating offline snapshot 8ebff846-abe9-434f-9221-6523a13a1221 of volume d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984ce29-11d7-4f53-b1d6-29baa675ab97]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:11 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 Jul 22 02:10:11 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:11 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" returned: 0 in 0.364s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0" released by "delete_volume" :: held 0.903s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Created reservations ['7051f74a-8b49-4eba-87ed-8b6483979414', '8c251995-5cb0-4c97-899a-288655cd9ccb', 'c1c29e01-0127-47ed-ba54-eef16448f73b', '11712a9b-0ca6-4028-8fa9-2e36e3db2770'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:11 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:11 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-d512da7b-660c-4d00-92c5-f1a33428442a-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-d512da7b-660c-4d00-92c5-f1a33428442a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:11 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" returned: 0 in 0.482s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:11 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 1G Jul 22 02:10:11 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" acquired by "delete_volume" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf2998a-3694-4299-b891-df9f603d819b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:12 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:12 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Deleted volume successfully. Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-d72af752-648d-405e-913f-9caf647adc1c tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-53f42cb3-bcb7-40c4-b9ce-ff44f4020ea0-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:12 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a Jul 22 02:10:12 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:12 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 1G" returned: 0 in 0.492s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:12 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 Jul 22 02:10:12 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:12 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a" returned: 0 in 0.535s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:12 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a Jul 22 02:10:12 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:12 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221" returned: 0 in 0.314s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 is being set with open permissions: ugo+rw Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:12 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 Jul 22 02:10:12 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:12 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d512da7b-660c-4d00-92c5-f1a33428442a" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-quobyte-d512da7b-660c-4d00-92c5-f1a33428442a" released by "delete_volume" :: held 0.850s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Created reservations ['1ab76b76-d6ac-43ae-919e-381664599b5c', '36b767de-320c-48e3-92cb-5ad0977e4a13', 'b9ea7174-1f43-44a4-ae73-4b1cb084172c', '611529ba-b2f1-4e8f-bbc5-cb0162ac5233'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:12 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221" returned: 0 in 0.260s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:12 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:12 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:13 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info Jul 22 02:10:13 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:13 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.260s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Deleted volume successfully. Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b21d9136-6004-41a2-b908-f0c95397618e tempest-SnapshotDependencyTests-1785163805 None] Lock "cinder-d512da7b-660c-4d00-92c5-f1a33428442a-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:13 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:13 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info is being set with open permissions: ugo+rw Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:13 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info Jul 22 02:10:13 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:13 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.info" returned: 0 in 0.261s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.015s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Creating offline snapshot 4db9eec6-90aa-499c-bbb9-0925c6b5ed54 of volume f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-83f49b7a-a804-4721-a2c9-76ce172e3e17 tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6388a16-557d-46b4-aa12-df1c443563ab]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:13 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f Jul 22 02:10:13 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:13 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:14 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 1G Jul 22 02:10:14 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:14 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 1G" returned: 0 in 0.402s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:14 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 Jul 22 02:10:14 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-8ebff846-abe9-434f-9221-6523a13a1221-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-8ebff846-abe9-434f-9221-6523a13a1221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-8ebff846-abe9-434f-9221-6523a13a1221" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-8ebff846-abe9-434f-9221-6523a13a1221" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot 8ebff846-abe9-434f-9221-6523a13a1221 of volume d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ae3439-bbb3-4ba7-95dc-129adfcdfb21]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:14 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 Jul 22 02:10:14 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:14 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:14 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 is being set with open permissions: ugo+rw Jul 22 02:10:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:14 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 Jul 22 02:10:14 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:15 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221" returned: 0 in 0.384s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:15 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54" returned: 0 in 0.277s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b30355e-473d-4aab-b67e-2449c12bdb0f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:15 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info Jul 22 02:10:15 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:15 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 Jul 22 02:10:15 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:15 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info is being set with open permissions: ugo+rw Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:15 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info Jul 22 02:10:15 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:15 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" returned: 0 in 0.422s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:15 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 Jul 22 02:10:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:15 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.info" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:15 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-601a26d4-0261-4e51-919f-3d5bb77dfd74 tempest-ProjectReaderTests-1436522352 None] Create snapshot completed successfully Jul 22 02:10:15 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221" returned: 0 in 0.466s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:15 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221 Jul 22 02:10:15 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:16 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0.8ebff846-abe9-434f-9221-6523a13a1221" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-8ebff846-abe9-434f-9221-6523a13a1221" released by "_delete_snapshot" :: held 1.636s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" released by "delete_snapshot" :: held 1.665s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Created reservations ['60fc95cd-a086-45f8-8e7d-4c7688c758af', '273d7cbe-5c03-4a35-b4d3-9c56852743b7', 'ad8664bf-2a56-439d-8a61-f85968696b39', 'ae56fe55-a018-4934-8014-3ee25a879d2b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51dfe27c-4b11-4d31-8217-d1ef74f194c1 tempest-ProjectMemberTests-724807965 None] Lock "cinder-8ebff846-abe9-434f-9221-6523a13a1221-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-d84c03cc-d992-4a80-8b3f-bb310f0d30c0-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "cinder-d84c03cc-d992-4a80-8b3f-bb310f0d30c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da6e6c-5d35-4fcf-a678-c6b8dd2885f4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:17 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 Jul 22 02:10:17 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-4db9eec6-90aa-499c-bbb9-0925c6b5ed54-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-4db9eec6-90aa-499c-bbb9-0925c6b5ed54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-4db9eec6-90aa-499c-bbb9-0925c6b5ed54" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-4db9eec6-90aa-499c-bbb9-0925c6b5ed54" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Deleting offline snapshot 4db9eec6-90aa-499c-bbb9-0925c6b5ed54 of volume f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] snapshot_file for this snap is: volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb88ea-d863-4e37-a383-2a792be945f5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:17 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 Jul 22 02:10:17 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:17 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:17 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0 Jul 22 02:10:17 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:17 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54" returned: 0 in 0.386s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:17 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64ee588-a253-4f1d-9977-dd9de3d11167]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d84c03cc-d992-4a80-8b3f-bb310f0d30c0" released by "delete_volume" :: held 0.755s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Created reservations ['43fc4e19-eacb-4bf7-a18e-6c9bcb0b18ea', '371b6f08-3bc1-4846-8b63-ee78309dfae3', '65f5feb7-1d3d-4337-acec-ee07d21bf235', '718fd1e1-8afb-4d14-b659-4e79a0ce2b1a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:17 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f Jul 22 02:10:17 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:17 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:17 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:18 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:18 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" returned: 0 in 0.449s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.298s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:18 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 Jul 22 02:10:18 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-825157b9-5c63-43a8-89d1-bc99d4254c4c tempest-ProjectMemberTests-724807965 None] Lock "cinder-d84c03cc-d992-4a80-8b3f-bb310f0d30c0-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:18 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54" returned: 0 in 0.479s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:18 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54 Jul 22 02:10:18 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (43585f85-9e96-48a5-bc88-38bb8dece86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e22bbf7-3d09-4233-bb5d-768313ff12ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e22bbf7-3d09-4233-bb5d-768313ff12ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156169503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712d34b-d00c-401e-9daf-78f0b42624f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:18Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70565914-cd53-4c34-86eb-ecf768152699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70565914-cd53-4c34-86eb-ecf768152699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060cd037-b403-4789-8973-101601f337b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060cd037-b403-4789-8973-101601f337b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c712d34b-d00c-401e-9daf-78f0b42624f7', 'volume_name': 'volume-c712d34b-d00c-401e-9daf-78f0b42624f7', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b11d0d8-db0a-48e0-8642-eb1e1afe2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b11d0d8-db0a-48e0-8642-eb1e1afe2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c74c16-f14e-441b-9660-83bb141c3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:18 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Volume c712d34b-d00c-401e-9daf-78f0b42624f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c712d34b-d00c-401e-9daf-78f0b42624f7', 'volume_size': 1} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156169503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c712d34b-d00c-401e-9daf-78f0b42624f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:18Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Creating volume c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:18 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:18 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 1073741824 Jul 22 02:10:18 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:18 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f.4db9eec6-90aa-499c-bbb9-0925c6b5ed54" returned: 0 in 0.296s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-4db9eec6-90aa-499c-bbb9-0925c6b5ed54" released by "_delete_snapshot" :: held 1.721s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" released by "delete_snapshot" :: held 1.750s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Created reservations ['a7661e91-4a33-47be-afa3-9463291ad090', '965d71f1-a8fa-48c4-a2c1-bd95868d1858', '4cba129e-763c-44a1-b2e2-61a84f364a51', '917db3e4-d966-43d4-8da7-95e5f0734f84'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Delete snapshot completed successfully. Jul 22 02:10:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-eaf61f4d-93b5-4005-9a7f-be686e9b64c9 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-4db9eec6-90aa-499c-bbb9-0925c6b5ed54-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:19 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 1073741824" returned: 0 in 0.505s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:19 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 Jul 22 02:10:19 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "cinder-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78ca534-6b79-4205-b368-230412cfa3c6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:19 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c74c16-f14e-441b-9660-83bb141c3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c712d34b-d00c-401e-9daf-78f0b42624f7', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:19 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f Jul 22 02:10:19 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da88cbc7-8952-4ad5-a12e-8122f4ceff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:19 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Volume volume-c712d34b-d00c-401e-9daf-78f0b42624f7 (c712d34b-d00c-401e-9daf-78f0b42624f7): created successfully Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da88cbc7-8952-4ad5-a12e-8122f4ceff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (43585f85-9e96-48a5-bc88-38bb8dece86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:19 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8734aaa2-e74f-4c90-ba5d-ab711f49d86c tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:19 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" returned: 0 in 0.423s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:19 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f Jul 22 02:10:19 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:20 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" returned: 0 in 0.270s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f" released by "delete_volume" :: held 0.822s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Created reservations ['d301635e-96d4-4276-a349-76d15bedbc45', 'c6d3432d-edc6-40b9-9710-931b1ce105ed', 'e58e1516-0c8d-4dae-9042-6040e691b34b', '81078b18-9c42-4d4b-a50c-d6c03b99d7a2'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:20 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:20 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:20 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.331s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Deleted volume successfully. Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9e50b6a9-a065-4b7b-b648-b2aea21176bc tempest-ProjectReaderTests-1436522352 None] Lock "cinder-f7b28e7f-e9f0-4bcf-8b6c-7efbccc6396f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Creating offline snapshot 89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 of volume c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b4e475-7065-40c4-be26-464316e9a949]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:21 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 Jul 22 02:10:21 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (c5300ad2-c17f-4222-aeda-865abe7416d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a1e15f-79e3-484c-9406-5985e6276ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a1e15f-79e3-484c-9406-5985e6276ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200824505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6f0325-48ff-45af-9f4f-0d621c291785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:21Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbbd6e9-56ae-425b-8944-ad08ee703a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbbd6e9-56ae-425b-8944-ad08ee703a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4221eb20-3a59-42ca-96d6-b8e13ae632e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4221eb20-3a59-42ca-96d6-b8e13ae632e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6f0325-48ff-45af-9f4f-0d621c291785', 'volume_name': 'volume-be6f0325-48ff-45af-9f4f-0d621c291785', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264c1a2-0fc4-49ee-843f-76228978963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264c1a2-0fc4-49ee-843f-76228978963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c66d234-ca97-4773-b262-7ffd7bd30d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:21 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Volume be6f0325-48ff-45af-9f4f-0d621c291785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6f0325-48ff-45af-9f4f-0d621c291785', 'volume_size': 1} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:21 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:21 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 1G Jul 22 02:10:21 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:21 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 1G" returned: 0 in 0.458s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:21 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c712d34b-d00c-401e-9daf-78f0b42624f7 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:21 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c712d34b-d00c-401e-9daf-78f0b42624f7 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 Jul 22 02:10:21 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:22 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c712d34b-d00c-401e-9daf-78f0b42624f7 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" returned: 0 in 0.299s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:22 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 is being set with open permissions: ugo+rw Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:22 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 Jul 22 02:10:22 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:22 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:22 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info Jul 22 02:10:22 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:22 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:22 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info is being set with open permissions: ugo+rw Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:22 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info Jul 22 02:10:22 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:22 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.info" returned: 0 in 0.258s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200824505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6f0325-48ff-45af-9f4f-0d621c291785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:21Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Creating volume be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:22 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:23 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:23 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 1073741824 Jul 22 02:10:23 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5f75da35-6b6e-4bc8-a540-61355385698f tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:23 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 1073741824" returned: 0 in 0.428s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:23 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 Jul 22 02:10:23 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785" returned: 0 in 0.244s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c66d234-ca97-4773-b262-7ffd7bd30d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6f0325-48ff-45af-9f4f-0d621c291785', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f7766b-6109-4fe0-8652-50dcbb78f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:23 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Volume volume-be6f0325-48ff-45af-9f4f-0d621c291785 (be6f0325-48ff-45af-9f4f-0d621c291785): created successfully Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f7766b-6109-4fe0-8652-50dcbb78f896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (c5300ad2-c17f-4222-aeda-865abe7416d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:23 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-cb0b9599-fd32-4b27-ad52-5453871e732a tempest-ProjectReaderTests-1436522352 None] Created volume successfully. Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:23 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot 89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 of volume c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[556bfbf7-7716-41e7-afd6-506f48cc53df]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:24 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 Jul 22 02:10:24 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Creating offline snapshot 08143e7e-52a5-4ff4-ae36-5023edcf4c8d of volume be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089eef8-5e25-4ff9-b9ce-860e298577d4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:24 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c712d34b-d00c-401e-9daf-78f0b42624f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a62349f-009c-4f8d-896f-b777f20174f5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:24 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 Jul 22 02:10:24 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:24 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 Jul 22 02:10:24 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:24 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785" returned: 0 in 0.362s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:24 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d 1G Jul 22 02:10:24 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:24 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:24 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:24 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 Jul 22 02:10:24 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:25 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d 1G" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6f0325-48ff-45af-9f4f-0d621c291785 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:25 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:25 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6f0325-48ff-45af-9f4f-0d621c291785 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d Jul 22 02:10:25 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:25 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767 Jul 22 02:10:25 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:25 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7.89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6f0325-48ff-45af-9f4f-0d621c291785 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d" returned: 0 in 0.307s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d is being set with open permissions: ugo+rw Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767" released by "_delete_snapshot" :: held 1.440s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" released by "delete_snapshot" :: held 1.466s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:25 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d Jul 22 02:10:25 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Created reservations ['650a1299-a033-43c4-bed3-556ca9e120d9', '2e2ca36d-7704-49cd-8b7d-14b77329fb80', 'b5a3550c-24f7-4742-9869-b738f4410044', 'd9f312a9-c5c9-442c-a7d1-479771f0dc65'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:25 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-de7e1a7b-e607-4f6e-8170-fc0d4d4ac153 tempest-ProjectMemberTests-724807965 None] Lock "cinder-89f22bb0-c4eb-4d3a-86a8-72ad3dafa767-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:25 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:25 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info Jul 22 02:10:25 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:25 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:25 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info is being set with open permissions: ugo+rw Jul 22 02:10:25 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:25 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info Jul 22 02:10:25 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-c712d34b-d00c-401e-9daf-78f0b42624f7-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "cinder-c712d34b-d00c-401e-9daf-78f0b42624f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:26 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.info" returned: 0 in 0.268s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:26 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1f516060-1e72-4dae-88e4-5437c84f1472 tempest-ProjectReaderTests-1436522352 None] Create snapshot completed successfully Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ddda30-812b-4fbe-92c2-3116ca48cf30]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:26 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 Jul 22 02:10:26 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-08143e7e-52a5-4ff4-ae36-5023edcf4c8d-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-08143e7e-52a5-4ff4-ae36-5023edcf4c8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-08143e7e-52a5-4ff4-ae36-5023edcf4c8d" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-08143e7e-52a5-4ff4-ae36-5023edcf4c8d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Deleting offline snapshot 08143e7e-52a5-4ff4-ae36-5023edcf4c8d of volume be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] snapshot_file for this snap is: volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ffda38-fe19-43bf-a5cb-ccfd35e441b8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:26 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d Jul 22 02:10:26 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:26 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7" returned: 0 in 0.375s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:26 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7 Jul 22 02:10:26 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:26 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6f0325-48ff-45af-9f4f-0d621c291785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818c3f2-25e7-40f1-8338-44ccb670f55f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:26 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-c712d34b-d00c-401e-9daf-78f0b42624f7" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:26 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c712d34b-d00c-401e-9daf-78f0b42624f7" released by "delete_volume" :: held 0.695s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Created reservations ['8b9810d5-bb63-4341-a161-f997b34b75ef', 'e69224e6-118e-467b-a7b9-8f1e865cce44', '49b488ab-d4ed-4181-ae5e-74c0a0544405', '908fe932-0034-48d3-999c-bcca8436b47c'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:27 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 Jul 22 02:10:27 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:27 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:27 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:27 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:27 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d Jul 22 02:10:27 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:27 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.261s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:27 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9bc3e89c-053c-43ef-9cee-09593f9c112c tempest-ProjectMemberTests-724807965 None] Lock "cinder-c712d34b-d00c-401e-9daf-78f0b42624f7-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:27 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d" returned: 0 in 0.396s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:27 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d Jul 22 02:10:27 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (3c08956f-f73b-49ab-96b1-0a3f3483cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d45831-c144-48bf-9fee-1bd1d6bd3aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d45831-c144-48bf-9fee-1bd1d6bd3aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918040341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d4411-d574-4cb9-ba97-a328a978b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:28Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ad56eb-9b62-48f5-aedc-b8900d54a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ad56eb-9b62-48f5-aedc-b8900d54a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4c2633-492a-4e27-aa7f-7cbcec6552c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4c2633-492a-4e27-aa7f-7cbcec6552c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3d4411-d574-4cb9-ba97-a328a978b249', 'volume_name': 'volume-0d3d4411-d574-4cb9-ba97-a328a978b249', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa373ceb-f39d-4429-88c0-05efbae5f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa373ceb-f39d-4429-88c0-05efbae5f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8412168a-52df-44af-809f-9af0fc11db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:27 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Volume 0d3d4411-d574-4cb9-ba97-a328a978b249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3d4411-d574-4cb9-ba97-a328a978b249', 'volume_size': 1} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918040341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3d4411-d574-4cb9-ba97-a328a978b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:28Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Creating volume 0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:27 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:27 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 1073741824 Jul 22 02:10:27 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:27 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:27 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785.08143e7e-52a5-4ff4-ae36-5023edcf4c8d" returned: 0 in 0.278s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-08143e7e-52a5-4ff4-ae36-5023edcf4c8d" released by "_delete_snapshot" :: held 1.481s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" released by "delete_snapshot" :: held 1.504s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Created reservations ['1446463a-afb5-4afd-ae43-93be76476dd9', 'e183726a-6162-42d5-bc09-641b831705b5', 'dcfc05ac-828f-4ad8-83d9-69ada191f63e', 'e3ca94c3-e457-4a99-82ab-06f7070b3f50'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Delete snapshot completed successfully. Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-9b7a2dd7-78f9-47de-90fd-38936059bf38 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-08143e7e-52a5-4ff4-ae36-5023edcf4c8d-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:28 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 1073741824" returned: 0 in 0.430s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:28 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 Jul 22 02:10:28 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-be6f0325-48ff-45af-9f4f-0d621c291785-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-be6f0325-48ff-45af-9f4f-0d621c291785-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:28 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" acquired by "delete_volume" :: waited 0.023s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249" returned: 0 in 0.297s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c769d-f87e-4af5-bef5-3bbf669108a8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8412168a-52df-44af-809f-9af0fc11db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3d4411-d574-4cb9-ba97-a328a978b249', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e839d7d-d7b7-4dcd-ae9f-32491844ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:28 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Volume volume-0d3d4411-d574-4cb9-ba97-a328a978b249 (0d3d4411-d574-4cb9-ba97-a328a978b249): created successfully Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e839d7d-d7b7-4dcd-ae9f-32491844ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:28 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (3c08956f-f73b-49ab-96b1-0a3f3483cb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:28 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-14dc8657-2b91-4cf6-811a-12e2632f5de3 tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:28 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 Jul 22 02:10:28 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:29 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785" returned: 0 in 0.363s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:29 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785 Jul 22 02:10:29 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:29 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-be6f0325-48ff-45af-9f4f-0d621c291785" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-be6f0325-48ff-45af-9f4f-0d621c291785" released by "delete_volume" :: held 0.702s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Created reservations ['750b1e85-ddc3-4bda-8f07-11128fb79211', '3ab62fe6-b9e9-47af-92a2-ec1a7f2405db', '88e0ec42-6112-4764-b55b-896cdf3812bc', '239e4e8c-d64b-48f0-b6c8-1e69b0b0ae7b'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:29 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:29 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:29 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:29 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Deleted volume successfully. Jul 22 02:10:29 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-51f0c42e-0712-4404-88c2-eb50aebe8b68 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-be6f0325-48ff-45af-9f4f-0d621c291785-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Creating offline snapshot c892705f-d0a2-4896-8bc3-14d820a7239d of volume 0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6795e4-6fb9-4ca8-b7a3-00f756e321c9]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:30 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 Jul 22 02:10:30 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (655e40c2-0d52-4d62-bdb1-1d0a76708037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f26ebf-ffe8-489c-9806-222a4a8e8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f26ebf-ffe8-489c-9806-222a4a8e8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367763116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:30Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827703f0-00b4-4e90-b97e-998da17c24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827703f0-00b4-4e90-b97e-998da17c24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f0e6d0-9c0a-4663-aca3-d1961273da32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f0e6d0-9c0a-4663-aca3-d1961273da32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269', 'volume_name': 'volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c624208e-f2d4-4cec-a5e6-679f15153a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c624208e-f2d4-4cec-a5e6-679f15153a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ca32d-6ac0-426c-805c-d27ae66e663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:30 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Volume d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269', 'volume_size': 1} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:30 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249" returned: 0 in 0.373s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:30 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d 1G Jul 22 02:10:30 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:30 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d 1G" returned: 0 in 0.384s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:30 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d4411-d574-4cb9-ba97-a328a978b249 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:30 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d4411-d574-4cb9-ba97-a328a978b249 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d Jul 22 02:10:30 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:31 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3d4411-d574-4cb9-ba97-a328a978b249 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d" returned: 0 in 0.281s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:31 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d is being set with open permissions: ugo+rw Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:31 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d Jul 22 02:10:31 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:31 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d" returned: 0 in 0.261s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:31 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info Jul 22 02:10:31 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:31 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:31 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info is being set with open permissions: ugo+rw Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:31 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info Jul 22 02:10:31 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:31 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.info" returned: 0 in 0.251s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367763116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:30Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Creating volume d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:31 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:31 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:31 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 1073741824 Jul 22 02:10:31 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:31 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2a416f0a-e3cb-4b63-9491-4dd53ce435ba tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-c892705f-d0a2-4896-8bc3-14d820a7239d-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-c892705f-d0a2-4896-8bc3-14d820a7239d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-c892705f-d0a2-4896-8bc3-14d820a7239d" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c892705f-d0a2-4896-8bc3-14d820a7239d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot c892705f-d0a2-4896-8bc3-14d820a7239d of volume 0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc215ede-2404-4c08-a7e5-792bc322d119]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:32 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d Jul 22 02:10:32 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:32 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 1073741824" returned: 0 in 0.478s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:32 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 Jul 22 02:10:32 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:32 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3d4411-d574-4cb9-ba97-a328a978b249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa7996-ebcd-4aa2-b081-b09ad554f4d5]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:32 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ca32d-6ac0-426c-805c-d27ae66e663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e32b5f-d19e-450d-817a-a48662c29ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:32 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Volume volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 (d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269): created successfully Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e32b5f-d19e-450d-817a-a48662c29ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:32 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (655e40c2-0d52-4d62-bdb1-1d0a76708037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:32 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-4ba898d1-3775-4e1b-8ccb-0f903c636c14 tempest-ProjectReaderTests-1436522352 None] Created volume successfully. Jul 22 02:10:32 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 Jul 22 02:10:32 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:33 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:33 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d Jul 22 02:10:33 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:33 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d" returned: 0 in 0.352s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:33 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d Jul 22 02:10:33 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Creating offline snapshot 2c87fd7b-934e-45cd-aa78-d69a1ced85ae of volume d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[18521d4c-039c-4250-8ea8-275bacb5531c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:33 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249.c892705f-d0a2-4896-8bc3-14d820a7239d" returned: 0 in 0.258s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-c892705f-d0a2-4896-8bc3-14d820a7239d" released by "_delete_snapshot" :: held 1.453s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" released by "delete_snapshot" :: held 1.478s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:33 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 Jul 22 02:10:33 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Created reservations ['977dd4db-c2f7-4f09-930e-c533591bd801', 'ff52b06b-57b3-462d-bf68-26604a99f2d7', 'e9c0a6dd-ed07-46fa-8063-959c6609d6f3', '543e6e09-2b06-4c83-a986-263f63b312a8'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:33 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:33 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-78e7f1a2-e608-454a-8c1e-4d08b9343fc5 tempest-ProjectMemberTests-724807965 None] Lock "cinder-c892705f-d0a2-4896-8bc3-14d820a7239d-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:33 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" returned: 0 in 0.370s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:34 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae 1G Jul 22 02:10:34 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-0d3d4411-d574-4cb9-ba97-a328a978b249-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "cinder-0d3d4411-d574-4cb9-ba97-a328a978b249-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:34 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae 1G" returned: 0 in 0.433s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:34 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae Jul 22 02:10:34 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5498da5b-c50a-432e-8fb1-b1c20653b09e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:34 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 Jul 22 02:10:34 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:34 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae" returned: 0 in 0.300s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:34 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae is being set with open permissions: ugo+rw Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:34 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae Jul 22 02:10:34 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:34 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249" returned: 0 in 0.372s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:34 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249 Jul 22 02:10:34 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:34 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:34 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae" returned: 0 in 0.248s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:35 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info Jul 22 02:10:35 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:35 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-0d3d4411-d574-4cb9-ba97-a328a978b249" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-0d3d4411-d574-4cb9-ba97-a328a978b249" released by "delete_volume" :: held 0.683s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Created reservations ['1c458019-659d-48c6-b868-29a73da96266', 'b6f7d101-4a7f-4b42-9cfb-6a06c670cc1d', '2ea2318f-ad3a-4833-a507-83bf5530de20', '92bb0124-408a-4a06-a980-739d7a80fda0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:35 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info" returned: 0 in 0.269s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:35 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info is being set with open permissions: ugo+rw Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:35 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:35 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:35 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info Jul 22 02:10:35 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:35 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.265s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:35 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.info" returned: 0 in 0.262s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a5afa275-e9a1-41af-b644-35c70ae9ea36 tempest-ProjectMemberTests-724807965 None] Lock "cinder-0d3d4411-d574-4cb9-ba97-a328a978b249-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:35 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9ed908e2-352b-4a22-8958-8d8c9d900d40 tempest-ProjectReaderTests-1436522352 None] Create snapshot completed successfully Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-2c87fd7b-934e-45cd-aa78-d69a1ced85ae-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-2c87fd7b-934e-45cd-aa78-d69a1ced85ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-2c87fd7b-934e-45cd-aa78-d69a1ced85ae" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-2c87fd7b-934e-45cd-aa78-d69a1ced85ae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Deleting offline snapshot 2c87fd7b-934e-45cd-aa78-d69a1ced85ae of volume d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] snapshot_file for this snap is: volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de9b0d4-3707-4c09-a2d3-901a4bd017ad]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:35 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:35 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae Jul 22 02:10:35 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (0ed16adc-3096-493f-92b8-9d2262fd0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b6d3ee-67b5-4d6c-9617-8a3d9e803f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b6d3ee-67b5-4d6c-9617-8a3d9e803f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370185392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554e87ab-35b3-491e-bbf2-78b477e3193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:36Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3ad6a5-26bc-4e4e-959b-b89f98e8ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3ad6a5-26bc-4e4e-959b-b89f98e8ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162927be-35fc-4b7e-92bb-5fbabd38be01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162927be-35fc-4b7e-92bb-5fbabd38be01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554e87ab-35b3-491e-bbf2-78b477e3193c', 'volume_name': 'volume-554e87ab-35b3-491e-bbf2-78b477e3193c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8988e63-07c5-438a-810c-cf009d8b54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8988e63-07c5-438a-810c-cf009d8b54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f13e01b-5181-410f-82f7-a0ff32e3c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Volume 554e87ab-35b3-491e-bbf2-78b477e3193c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554e87ab-35b3-491e-bbf2-78b477e3193c', 'volume_size': 1} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370185392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554e87ab-35b3-491e-bbf2-78b477e3193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:36Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Creating volume 554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:36 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:36 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c 1073741824 Jul 22 02:10:36 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:36 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae" returned: 0 in 0.387s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[de74717b-25ea-45b6-893f-980e6f89f88a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:36 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 Jul 22 02:10:36 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:36 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c 1073741824" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:36 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c Jul 22 02:10:36 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:36 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:36 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae Jul 22 02:10:36 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:36 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c" returned: 0 in 0.240s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f13e01b-5181-410f-82f7-a0ff32e3c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554e87ab-35b3-491e-bbf2-78b477e3193c', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a192f04b-edc5-4e46-b818-de674275a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:36 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Volume volume-554e87ab-35b3-491e-bbf2-78b477e3193c (554e87ab-35b3-491e-bbf2-78b477e3193c): created successfully Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a192f04b-edc5-4e46-b818-de674275a770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:36 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (0ed16adc-3096-493f-92b8-9d2262fd0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:36 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-0e830d1c-6043-4aa4-9502-88dc5d913d3e tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:37 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:37 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae Jul 22 02:10:37 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Creating offline snapshot fbd3c0f7-cd34-4162-914e-a37f8f428846 of volume 554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e5fad-7f0b-4a69-b25d-6ffe27cc295c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:37 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269.2c87fd7b-934e-45cd-aa78-d69a1ced85ae" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-2c87fd7b-934e-45cd-aa78-d69a1ced85ae" released by "_delete_snapshot" :: held 1.511s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" released by "delete_snapshot" :: held 1.543s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:37 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c Jul 22 02:10:37 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Created reservations ['161e3803-5295-4482-a317-0c4689bc812b', 'ceb507b1-f961-46e0-abcf-a977c9500882', '000850fc-5894-46c3-ad6c-f9fdf70801ad', '572c8370-6187-44ec-b464-e06c4187195d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:37 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Delete snapshot completed successfully. Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-fe8ddb9c-09fa-4186-aced-043213cda797 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-2c87fd7b-934e-45cd-aa78-d69a1ced85ae-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:37 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:37 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 1G Jul 22 02:10:37 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "cinder-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:37 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33fc070-b28d-4f17-9300-89cc662cdee7]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 1G" returned: 0 in 0.443s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554e87ab-35b3-491e-bbf2-78b477e3193c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554e87ab-35b3-491e-bbf2-78b477e3193c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 Jul 22 02:10:38 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 Jul 22 02:10:38 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554e87ab-35b3-491e-bbf2-78b477e3193c -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846" returned: 0 in 0.297s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 is being set with open permissions: ugo+rw Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 Jul 22 02:10:38 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" returned: 0 in 0.388s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269 Jul 22 02:10:38 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info Jul 22 02:10:38 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269" released by "delete_volume" :: held 0.699s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Created reservations ['1a655459-aacc-4f42-8a2d-c0c1567c6995', 'd093ce76-9a8a-4578-bf67-26f9802f1040', 'd4f98ec0-bc1f-4ade-856d-5e192ba3df60', '1d6546ec-817b-47d8-bd4d-7f6c81f14421'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:38 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:38 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info" returned: 0 in 0.260s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:38 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info is being set with open permissions: ugo+rw Jul 22 02:10:38 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:38 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info Jul 22 02:10:38 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:39 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.271s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Deleted volume successfully. Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2338212d-fbc7-40a1-b1fd-50b7dd4e788d tempest-ProjectReaderTests-1436522352 None] Lock "cinder-d1c6ab61-2e44-4e9a-95a4-4f7d0c1a5269-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:39 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.info" returned: 0 in 0.259s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:39 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-5172c17a-2ade-4c55-8000-b60aaf1c03fc tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-fbd3c0f7-cd34-4162-914e-a37f8f428846-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-fbd3c0f7-cd34-4162-914e-a37f8f428846-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-fbd3c0f7-cd34-4162-914e-a37f8f428846" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-fbd3c0f7-cd34-4162-914e-a37f8f428846" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot fbd3c0f7-cd34-4162-914e-a37f8f428846 of volume 554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecdaeb8-1656-4eac-9fa6-7490386c7ef8]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:39 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 Jul 22 02:10:39 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:39 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (725e8186-1cb1-4fce-a83e-d02aab68945a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d5fa2-f683-4cdc-a89b-beefe0bb59bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-554e87ab-35b3-491e-bbf2-78b477e3193c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2d5fa2-f683-4cdc-a89b-beefe0bb59bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235505183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70950980-3f52-42a7-90df-40bd66eb19dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:40Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48106328-1eda-47d7-b87d-cd28a5f8e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48106328-1eda-47d7-b87d-cd28a5f8e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c237a9f-42c5-41e3-9fb2-e9f237edcfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c237a9f-42c5-41e3-9fb2-e9f237edcfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70950980-3f52-42a7-90df-40bd66eb19dd', 'volume_name': 'volume-70950980-3f52-42a7-90df-40bd66eb19dd', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3368728a-9a97-42b8-9da9-ee8f729b993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3368728a-9a97-42b8-9da9-ee8f729b993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673803bb-92c8-4608-8492-6587783c0519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:39 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Volume 70950980-3f52-42a7-90df-40bd66eb19dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70950980-3f52-42a7-90df-40bd66eb19dd', 'volume_size': 1} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235505183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70950980-3f52-42a7-90df-40bd66eb19dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:40Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Creating volume 70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:39 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac97ac-e1c5-4d96-b2c1-d78a52bd1ddb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:39 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:39 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd 1073741824 Jul 22 02:10:39 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:40 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c Jul 22 02:10:40 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:40 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c" returned: 0 in 0.396s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:40 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd 1073741824" returned: 0 in 0.423s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:40 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 Jul 22 02:10:40 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:40 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd Jul 22 02:10:40 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:40 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd" returned: 0 in 0.264s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673803bb-92c8-4608-8492-6587783c0519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70950980-3f52-42a7-90df-40bd66eb19dd', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ca26d-858f-4c56-a1bf-1604b8dbcc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:40 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:40 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Volume volume-70950980-3f52-42a7-90df-40bd66eb19dd (70950980-3f52-42a7-90df-40bd66eb19dd): created successfully Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ca26d-858f-4c56-a1bf-1604b8dbcc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (725e8186-1cb1-4fce-a83e-d02aab68945a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846" returned: 0 in 0.368s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:40 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-271f59fc-e7a5-498b-afdc-11aecc57ac66 tempest-ProjectReaderTests-1436522352 None] Created volume successfully. Jul 22 02:10:40 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846 Jul 22 02:10:40 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:40 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c.fbd3c0f7-cd34-4162-914e-a37f8f428846" returned: 0 in 0.272s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:40 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-fbd3c0f7-cd34-4162-914e-a37f8f428846" released by "_delete_snapshot" :: held 1.604s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Creating offline snapshot 3e604567-06dd-4a04-ab49-1372557031e2 of volume 70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" released by "delete_snapshot" :: held 1.640s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d92cf-fef0-42a9-add8-d8c77251aaeb]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Created reservations ['ba242861-b4dc-43b5-ae3f-1b77528000b2', '7fd8b3dd-b3fd-4046-a4ff-37987148729f', 'eb110644-2384-46b0-bf3a-725878bbae35', 'd09c699f-cc9c-421d-89fb-8931f28dad2a'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:41 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:41 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd Jul 22 02:10:41 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-a04f6dca-27d8-4dc1-a1c3-b48369523ded tempest-ProjectMemberTests-724807965 None] Lock "cinder-fbd3c0f7-cd34-4162-914e-a37f8f428846-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:41 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:41 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 1G Jul 22 02:10:41 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-554e87ab-35b3-491e-bbf2-78b477e3193c-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "cinder-554e87ab-35b3-491e-bbf2-78b477e3193c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[24469aa5-3d15-4fda-8519-c6330424a1f0]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:41 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c Jul 22 02:10:41 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:41 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 1G" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70950980-3f52-42a7-90df-40bd66eb19dd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:41 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70950980-3f52-42a7-90df-40bd66eb19dd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 Jul 22 02:10:41 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:41 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:41 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:42 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c Jul 22 02:10:42 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:42 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70950980-3f52-42a7-90df-40bd66eb19dd -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2" returned: 0 in 0.286s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 is being set with open permissions: ugo+rw Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:42 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 Jul 22 02:10:42 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:42 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-554e87ab-35b3-491e-bbf2-78b477e3193c" returned: 0 in 0.239s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-554e87ab-35b3-491e-bbf2-78b477e3193c" released by "delete_volume" :: held 0.669s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Created reservations ['173038e7-a904-4e8a-91aa-b04b5aa86cb9', '923ec126-d140-4fa7-b12b-44d83646ae80', '3bf7396d-f998-47d6-863d-abce1b7a90af', '5e8f1134-62ac-42d2-b256-c1acfa412ddb'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:42 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2" returned: 0 in 0.248s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:42 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:42 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:42 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info Jul 22 02:10:42 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:42 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:42 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:42 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info" returned: 0 in 0.285s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info is being set with open permissions: ugo+rw Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1839190f-a027-4884-bb84-f927343b863a tempest-ProjectMemberTests-724807965 None] Lock "cinder-554e87ab-35b3-491e-bbf2-78b477e3193c-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:42 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info Jul 22 02:10:42 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:42 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.info" returned: 0 in 0.254s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:42 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-aa63370a-4fd5-46d5-8d6d-d609f6ee4844 tempest-ProjectReaderTests-1436522352 None] Create snapshot completed successfully Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (702104e8-111e-4320-b848-c6828095a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e144ce-7875-4f0a-9773-716f49c853b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e144ce-7875-4f0a-9773-716f49c853b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360265802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcd44f0-9664-453a-817d-5d526f9276ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:43Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09b51e6-044c-4ef1-ad37-a071357f0308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09b51e6-044c-4ef1-ad37-a071357f0308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d5e79b-27ab-48c1-b437-a67f92db44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d5e79b-27ab-48c1-b437-a67f92db44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdcd44f0-9664-453a-817d-5d526f9276ef', 'volume_name': 'volume-bdcd44f0-9664-453a-817d-5d526f9276ef', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307723d6-960e-4b87-86ba-9990ff0f84ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307723d6-960e-4b87-86ba-9990ff0f84ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4219fb5-ea86-4c21-8082-620d4fe48af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Volume bdcd44f0-9664-453a-817d-5d526f9276ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdcd44f0-9664-453a-817d-5d526f9276ef', 'volume_size': 1} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1360265802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcd44f0-9664-453a-817d-5d526f9276ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:43Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Creating volume bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:43 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:43 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef 1073741824 Jul 22 02:10:43 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:43 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef 1073741824" returned: 0 in 0.417s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:43 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef Jul 22 02:10:43 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:43 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4219fb5-ea86-4c21-8082-620d4fe48af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdcd44f0-9664-453a-817d-5d526f9276ef', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d9f4ef-c829-4d49-9847-f1a3328946f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:43 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Volume volume-bdcd44f0-9664-453a-817d-5d526f9276ef (bdcd44f0-9664-453a-817d-5d526f9276ef): created successfully Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d9f4ef-c829-4d49-9847-f1a3328946f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:43 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (702104e8-111e-4320-b848-c6828095a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:43 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1c24272c-9da2-47f3-b2d8-c50d5977297e tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-3e604567-06dd-4a04-ab49-1372557031e2-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-3e604567-06dd-4a04-ab49-1372557031e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-3e604567-06dd-4a04-ab49-1372557031e2" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-3e604567-06dd-4a04-ab49-1372557031e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Deleting offline snapshot 3e604567-06dd-4a04-ab49-1372557031e2 of volume 70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] snapshot_file for this snap is: volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe31630-dbea-41a9-9702-6580d10ce021]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:44 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:44 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Creating offline snapshot f2f5060b-40f4-4835-993d-d5773262e84c of volume bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a33022-aea3-4d2a-bd8a-d22bb6ddea1c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:44 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef Jul 22 02:10:44 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:44 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2" returned: 0 in 0.383s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70950980-3f52-42a7-90df-40bd66eb19dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092d28c-bf16-4803-9ae6-0b9f70b6ba8d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:44 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:44 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd Jul 22 02:10:44 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:44 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:44 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c 1G Jul 22 02:10:44 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:45 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 Jul 22 02:10:45 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c 1G" returned: 0 in 0.402s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdcd44f0-9664-453a-817d-5d526f9276ef -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:45 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdcd44f0-9664-453a-817d-5d526f9276ef -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c Jul 22 02:10:45 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2" returned: 0 in 0.377s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:45 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2 Jul 22 02:10:45 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdcd44f0-9664-453a-817d-5d526f9276ef -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c" returned: 0 in 0.302s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c is being set with open permissions: ugo+rw Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:45 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c Jul 22 02:10:45 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd.3e604567-06dd-4a04-ab49-1372557031e2" returned: 0 in 0.259s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-3e604567-06dd-4a04-ab49-1372557031e2" released by "_delete_snapshot" :: held 1.491s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" released by "delete_snapshot" :: held 1.517s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=248,cinder:DELETE=21,cinder:SELECT=208,cinder:INSERT=68 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:UPDATE=266,cinder:DELETE=24,cinder:SELECT=189,cinder:INSERT=66 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:10:45 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c" returned: 0 in 0.248s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:45 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info Jul 22 02:10:45 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Created reservations ['609e6601-7285-4733-8323-76f206d2db1c', 'f2efabc3-5e85-4c65-b854-c8d611122794', 'cc415400-9879-4800-96d8-ba859f01c001', '2f63ffb7-cc4b-4d03-9c25-a69d385f9e51'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:45 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Delete snapshot completed successfully. Jul 22 02:10:45 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-49c87d05-e546-488b-a408-d47fbfdd0121 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-3e604567-06dd-4a04-ab49-1372557031e2-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:46 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:46 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info is being set with open permissions: ugo+rw Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:46 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info Jul 22 02:10:46 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:46 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.info" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:46 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8b7b4d93-91d2-4128-9d80-5d09ccf39387 tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-70950980-3f52-42a7-90df-40bd66eb19dd-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-70950980-3f52-42a7-90df-40bd66eb19dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" acquired by "delete_volume" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b76fa9f-3c88-49fc-a4e5-3176bf06134c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-f2f5060b-40f4-4835-993d-d5773262e84c-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-f2f5060b-40f4-4835-993d-d5773262e84c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-f2f5060b-40f4-4835-993d-d5773262e84c" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-f2f5060b-40f4-4835-993d-d5773262e84c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:46 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd Jul 22 02:10:46 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot f2f5060b-40f4-4835-993d-d5773262e84c of volume bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0834a5c-754f-42ae-94ed-2ab3ca285ee1]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:46 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c Jul 22 02:10:46 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:46 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:46 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd Jul 22 02:10:46 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:46 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:46 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdcd44f0-9664-453a-817d-5d526f9276ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[082128c8-f69b-4146-98b3-6d19491566ee]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:47 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-70950980-3f52-42a7-90df-40bd66eb19dd" returned: 0 in 0.266s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-70950980-3f52-42a7-90df-40bd66eb19dd" released by "delete_volume" :: held 0.713s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:47 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef Jul 22 02:10:47 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Created reservations ['3dd9d633-f0e9-46a8-a429-0bc4bd263c1a', '561521c9-8e69-4afe-8359-91998a034ff3', 'f0fba7b0-da42-4a16-b475-357224c68e57', '3c920b72-fc58-4477-8e49-f0246aa977bb'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:47 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:47 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:47 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef" returned: 0 in 0.398s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:47 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c Jul 22 02:10:47 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:47 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.264s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:47 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Deleted volume successfully. Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8a753a4d-f8b6-463c-8716-88dbff8643f1 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-70950980-3f52-42a7-90df-40bd66eb19dd-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:47 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c" returned: 0 in 0.381s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:47 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c Jul 22 02:10:47 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (b4ac251c-eaea-4f08-90b4-6351600a8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b73ca-3ede-447f-8757-467b64f58aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137b73ca-3ede-447f-8757-467b64f58aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1462680961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a8b22e-aec8-413b-803f-35e7c1e056e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:48Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:47 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b31f806-923f-4d2d-b5e7-43687ee72f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b31f806-923f-4d2d-b5e7-43687ee72f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d290be73-3aed-4157-bd80-951489c9cb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d290be73-3aed-4157-bd80-951489c9cb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a8b22e-aec8-413b-803f-35e7c1e056e6', 'volume_name': 'volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d01e66-20ce-4899-ba49-4f4e8646bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d01e66-20ce-4899-ba49-4f4e8646bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab640765-27f1-4334-902e-09d4dec4b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Volume f6a8b22e-aec8-413b-803f-35e7c1e056e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6', 'volume_size': 1} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1462680961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a8b22e-aec8-413b-803f-35e7c1e056e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57877fb7bf04991be070580f7664077',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:48Z,use_quota=True,user_id='bc34c12f13ec4c63a1540fcd19687070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Creating volume f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:48 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:48 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef.f2f5060b-40f4-4835-993d-d5773262e84c" returned: 0 in 0.262s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:48 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 1073741824 Jul 22 02:10:48 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-f2f5060b-40f4-4835-993d-d5773262e84c" released by "_delete_snapshot" :: held 1.523s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" released by "delete_snapshot" :: held 1.548s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Created reservations ['040c4c8a-cbb6-45a5-ad0f-d6898c50face', 'cc716a18-517d-4d8d-9953-f0a525948977', '6d7cfd5f-887b-4b32-b6b5-9a4467bee62e', '3ea7e244-d53a-4d08-9a1e-44ee8e9eba48'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-942d6692-43a4-40fc-84a2-ebcdabaad131 tempest-ProjectMemberTests-724807965 None] Lock "cinder-f2f5060b-40f4-4835-993d-d5773262e84c-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:48 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 1073741824" returned: 0 in 0.406s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:48 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 Jul 22 02:10:48 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-bdcd44f0-9664-453a-817d-5d526f9276ef-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "cinder-bdcd44f0-9664-453a-817d-5d526f9276ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:48 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6" returned: 0 in 0.260s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab640765-27f1-4334-902e-09d4dec4b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c535a85-5152-4e91-88eb-63c66ef95a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeab196-88ea-4f22-ab0b-c3317352e383]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:48 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Volume volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 (f6a8b22e-aec8-413b-803f-35e7c1e056e6): created successfully Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c535a85-5152-4e91-88eb-63c66ef95a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:48 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Flow 'volume_create_manager' (b4ac251c-eaea-4f08-90b4-6351600a8899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:48 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-df2c9f1b-9121-4c04-b368-3bf352b93d06 tempest-ProjectReaderTests-1436522352 None] Created volume successfully. Jul 22 02:10:48 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef Jul 22 02:10:48 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Creating offline snapshot daa69a7b-60ea-4413-b006-6290479c5967 of volume f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[152893b9-3661-4bce-9c8f-85daf5dc1d13]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:49 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef" returned: 0 in 0.433s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:49 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef Jul 22 02:10:49 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:49 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 Jul 22 02:10:49 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:49 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-bdcd44f0-9664-453a-817d-5d526f9276ef" returned: 0 in 0.252s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-bdcd44f0-9664-453a-817d-5d526f9276ef" released by "delete_volume" :: held 0.755s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Created reservations ['010d7118-e314-4120-8240-eef3a28f0c57', 'fadc6cca-81cf-481e-8805-efdea0c29053', '41d2dacd-e688-4064-b85e-f06c4ef8d2f8', '64fd2a9c-a5e3-4890-b4c3-bef1cf4f65ad'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:49 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6" returned: 0 in 0.371s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:49 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 1G Jul 22 02:10:49 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:49 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:49 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:49 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.244s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:49 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:49 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-473030e0-eb94-4e1d-b03d-af38be848e87 tempest-ProjectMemberTests-724807965 None] Lock "cinder-bdcd44f0-9664-453a-817d-5d526f9276ef-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:50 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 1G" returned: 0 in 0.414s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:50 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 Jul 22 02:10:50 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:50 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967" returned: 0 in 0.316s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 is being set with open permissions: ugo+rw Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:50 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 Jul 22 02:10:50 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (3a740e35-6585-4d21-ac62-c417b46b5fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e02a2f-25f9-4915-882a-64e5374f4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e02a2f-25f9-4915-882a-64e5374f4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213058222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec667db-8f01-4e20-85cf-e1c0d1696613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:50Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e7544-a850-424d-bb63-e2ab145dc83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8e7544-a850-424d-bb63-e2ab145dc83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91b52b4-d7a9-43dc-8ed5-70b3cb6ad05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91b52b4-d7a9-43dc-8ed5-70b3cb6ad05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec667db-8f01-4e20-85cf-e1c0d1696613', 'volume_name': 'volume-cec667db-8f01-4e20-85cf-e1c0d1696613', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a1989-227c-408f-b9ac-001f3be23e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a1989-227c-408f-b9ac-001f3be23e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1767b3-6056-43be-a398-2661d3031293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:50 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Volume cec667db-8f01-4e20-85cf-e1c0d1696613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec667db-8f01-4e20-85cf-e1c0d1696613', 'volume_size': 1} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:50 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:50 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info Jul 22 02:10:50 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:50 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info" returned: 0 in 0.250s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:50 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info is being set with open permissions: ugo+rw Jul 22 02:10:50 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:50 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info Jul 22 02:10:50 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:51 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.info" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213058222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec667db-8f01-4e20-85cf-e1c0d1696613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:10:50Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Creating volume cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:51 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:51 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 1073741824 Jul 22 02:10:51 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-e2e08d91-a421-4d17-b0fb-6a707c5950a4 tempest-ProjectReaderTests-1436522352 None] Create snapshot completed successfully Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-daa69a7b-60ea-4413-b006-6290479c5967-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-daa69a7b-60ea-4413-b006-6290479c5967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-daa69a7b-60ea-4413-b006-6290479c5967" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-daa69a7b-60ea-4413-b006-6290479c5967" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Deleting offline snapshot daa69a7b-60ea-4413-b006-6290479c5967 of volume f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] snapshot_file for this snap is: volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e1304-7e5a-4ad9-b88b-ba13c97c8175]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:51 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 Jul 22 02:10:51 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:51 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 1073741824" returned: 0 in 0.439s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:51 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 Jul 22 02:10:51 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:51 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967" returned: 0 in 0.382s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4e876-706f-429d-a5ba-ea45cc6e61e6]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:51 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1767b3-6056-43be-a398-2661d3031293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec667db-8f01-4e20-85cf-e1c0d1696613', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63c34e1-088b-4536-ba99-f09fd4204935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:51 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Volume volume-cec667db-8f01-4e20-85cf-e1c0d1696613 (cec667db-8f01-4e20-85cf-e1c0d1696613): created successfully Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63c34e1-088b-4536-ba99-f09fd4204935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:51 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (3a740e35-6585-4d21-ac62-c417b46b5fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:51 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-64458246-6f38-4145-91a7-dfa1b50bbe06 tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:10:51 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 Jul 22 02:10:51 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:52 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6" returned: 0 in 0.350s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:52 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 Jul 22 02:10:52 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:52 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:52 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:52 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967" returned: 0 in 0.395s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:52 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967 Jul 22 02:10:52 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Creating offline snapshot 3bfdd5d3-4c48-460e-8024-4cb688204358 of volume cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59dad9c-f6a1-48ce-9bbc-0e2335f6e96a]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:52 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.276s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:52 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 Jul 22 02:10:52 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_service.periodic_task [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] Running periodic task VolumeManager._thread_info {{(pid=87153) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread count: 28 {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-1fb84426-4078-4b13-b264-feca6514eeda None None] thread info: [<_MainThread(MainThread, started 124263347904640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87153) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 22 02:10:52 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6.daa69a7b-60ea-4413-b006-6290479c5967" returned: 0 in 0.263s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-daa69a7b-60ea-4413-b006-6290479c5967" released by "_delete_snapshot" :: held 1.483s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" released by "delete_snapshot" :: held 1.510s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:52 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Created reservations ['36c2fe38-7a99-4848-a6bf-6f7d69bc5c0c', '252a2e7f-17ea-436c-b3f8-19d3e152f19d', 'cb59ae66-0a9e-466f-9d05-251d11fc1844', '096547e1-b06b-49be-84d6-cb58b16626ea'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:52 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Delete snapshot completed successfully. Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1b4cb0cb-d95f-4793-a4ef-c6b73081af03 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-daa69a7b-60ea-4413-b006-6290479c5967-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:53 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613" returned: 0 in 0.378s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:53 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 1G Jul 22 02:10:53 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:53 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 1G" returned: 0 in 0.387s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec667db-8f01-4e20-85cf-e1c0d1696613 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:53 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec667db-8f01-4e20-85cf-e1c0d1696613 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 Jul 22 02:10:53 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-f6a8b22e-aec8-413b-803f-35e7c1e056e6-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-f6a8b22e-aec8-413b-803f-35e7c1e056e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[97885c2a-5052-4ffc-991e-13d699608316]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:53 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec667db-8f01-4e20-85cf-e1c0d1696613 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358" returned: 0 in 0.311s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:53 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 is being set with open permissions: ugo+rw Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:53 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 Jul 22 02:10:53 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:53 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 Jul 22 02:10:53 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:53 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:53 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358" returned: 0 in 0.255s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:53 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:54 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6 Jul 22 02:10:54 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:54 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info Jul 22 02:10:54 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:54 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-f6a8b22e-aec8-413b-803f-35e7c1e056e6" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:54 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-quobyte-f6a8b22e-aec8-413b-803f-35e7c1e056e6" released by "delete_volume" :: held 0.694s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info" returned: 0 in 0.245s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:54 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info is being set with open permissions: ugo+rw Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:54 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info Jul 22 02:10:54 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Created reservations ['0904bcbc-af30-4fc7-92cb-91b3488e100c', '7b8741af-3e69-4413-a7d7-7e419231d378', '8ec533e3-b8aa-47e7-a7a9-27b6e53ab31e', 'c19f2730-3642-457d-89e9-f6a7c6a13b1f'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:54 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:54 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:54 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.info" returned: 0 in 0.279s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-344700d8-4baf-49a3-8592-1d71fd9721ca tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:10:54 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.274s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:54 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Deleted volume successfully. Jul 22 02:10:54 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-8649df63-e736-4aa0-ba38-28fcd35b6c56 tempest-ProjectReaderTests-1436522352 None] Lock "cinder-f6a8b22e-aec8-413b-803f-35e7c1e056e6-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-3bfdd5d3-4c48-460e-8024-4cb688204358-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-3bfdd5d3-4c48-460e-8024-4cb688204358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-3bfdd5d3-4c48-460e-8024-4cb688204358" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-3bfdd5d3-4c48-460e-8024-4cb688204358" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot 3bfdd5d3-4c48-460e-8024-4cb688204358 of volume cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab7edd-a482-440c-8bed-b729ad12ca9c]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:55 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:56 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 Jul 22 02:10:56 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:56 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358" returned: 0 in 0.379s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cec667db-8f01-4e20-85cf-e1c0d1696613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb400f6-ba8c-4761-bc4c-a9727b52666e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:56 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 Jul 22 02:10:56 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613" returned: 0 in 0.404s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:56 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:56 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 Jul 22 02:10:56 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:57 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:57 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358 Jul 22 02:10:57 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:57 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613.3bfdd5d3-4c48-460e-8024-4cb688204358" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-3bfdd5d3-4c48-460e-8024-4cb688204358" released by "_delete_snapshot" :: held 1.503s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" released by "delete_snapshot" :: held 1.575s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Created reservations ['00898430-d6d4-4ac0-91e9-9ca8072df498', '91849728-60c6-43d3-8ed5-3a57fbccc947', '88dae95d-46ed-41c9-a6b5-b55494ed7f3f', '8c0f15e3-94d8-45fd-8837-4845ad3f3be9'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:57 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-2754fdcb-201c-4d3e-b038-644558ff780c tempest-ProjectMemberTests-724807965 None] Lock "cinder-3bfdd5d3-4c48-460e-8024-4cb688204358-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-cec667db-8f01-4e20-85cf-e1c0d1696613-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "cinder-cec667db-8f01-4e20-85cf-e1c0d1696613-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:57 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d0b16-3749-4e6a-9b35-f81d1e5e4f83]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:58 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 Jul 22 02:10:58 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:58 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613" returned: 0 in 0.347s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:58 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613 Jul 22 02:10:58 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:58 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-cec667db-8f01-4e20-85cf-e1c0d1696613" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-cec667db-8f01-4e20-85cf-e1c0d1696613" released by "delete_volume" :: held 0.643s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Created reservations ['2afa658b-1fa0-4c22-95e0-5490408f97c9', 'ba5e4603-515c-4b56-815a-9be461b1aae2', '3a567b33-ad15-4992-9637-e8fc3a09cde1', 'e7763e2d-94a9-4d1c-9b22-1af0e544a9d7'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:58 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:58 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:10:58 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:10:59 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:10:59 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-ebf2c88d-31d3-4f43-8e14-7338705cf499 tempest-ProjectMemberTests-724807965 None] Lock "cinder-cec667db-8f01-4e20-85cf-e1c0d1696613-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (aa2f5591-23d7-428d-b5e8-42e7250a732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a342f15d-1b8a-449b-9faa-f973d54856a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a342f15d-1b8a-449b-9faa-f973d54856a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426501496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96cb540-c3a5-44fd-a504-c806771a4f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:00Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823f658e-7a92-4d7f-9159-3090c35aef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823f658e-7a92-4d7f-9159-3090c35aef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506e3fa0-4c36-4be2-a505-bdbdd87af0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506e3fa0-4c36-4be2-a505-bdbdd87af0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96cb540-c3a5-44fd-a504-c806771a4f38', 'volume_name': 'volume-a96cb540-c3a5-44fd-a504-c806771a4f38', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb99ae-af01-41e6-be70-1e48e7d189c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effb99ae-af01-41e6-be70-1e48e7d189c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261192df-a13f-49b1-b87c-fd848b917a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:10:59 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Volume a96cb540-c3a5-44fd-a504-c806771a4f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96cb540-c3a5-44fd-a504-c806771a4f38', 'volume_size': 1} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426501496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96cb540-c3a5-44fd-a504-c806771a4f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:00Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Creating volume a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:10:59 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:10:59 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:10:59 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 1073741824 Jul 22 02:10:59 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:00 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 1073741824" returned: 0 in 0.416s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:00 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 Jul 22 02:11:00 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:00 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261192df-a13f-49b1-b87c-fd848b917a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96cb540-c3a5-44fd-a504-c806771a4f38', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6621267a-d692-45eb-b237-89272148bd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:00 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Volume volume-a96cb540-c3a5-44fd-a504-c806771a4f38 (a96cb540-c3a5-44fd-a504-c806771a4f38): created successfully Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6621267a-d692-45eb-b237-89272148bd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (aa2f5591-23d7-428d-b5e8-42e7250a732a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:11:00 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-11e8b17b-441a-4c3c-b909-6d9a19040bee tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Creating offline snapshot b107da46-f877-47d8-a97c-94516a883cd1 of volume a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380fa4b-9971-455b-98d6-0400ff10353f]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:00 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:00 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 Jul 22 02:11:00 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:01 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38" returned: 0 in 0.358s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:01 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 1G Jul 22 02:11:01 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:01 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 1G" returned: 0 in 0.467s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96cb540-c3a5-44fd-a504-c806771a4f38 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:01 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96cb540-c3a5-44fd-a504-c806771a4f38 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 Jul 22 02:11:01 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:01 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96cb540-c3a5-44fd-a504-c806771a4f38 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1" returned: 0 in 0.287s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:01 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 is being set with open permissions: ugo+rw Jul 22 02:11:01 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:01 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 Jul 22 02:11:01 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:02 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1" returned: 0 in 0.234s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:02 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info Jul 22 02:11:02 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:02 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:02 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info is being set with open permissions: ugo+rw Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:02 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info Jul 22 02:11:02 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:02 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.info" returned: 0 in 0.273s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:02 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-2be376c9-fffe-4a23-a3f9-e483345971de tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-b107da46-f877-47d8-a97c-94516a883cd1-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-b107da46-f877-47d8-a97c-94516a883cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-b107da46-f877-47d8-a97c-94516a883cd1" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-b107da46-f877-47d8-a97c-94516a883cd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot b107da46-f877-47d8-a97c-94516a883cd1 of volume a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4b5e7-c8cd-46b1-8dab-baffbdee725b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:02 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:03 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 Jul 22 02:11:03 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:03 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1" returned: 0 in 0.369s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96cb540-c3a5-44fd-a504-c806771a4f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c821e-c118-48d2-a265-2fe107586230]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:03 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 Jul 22 02:11:03 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:03 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38" returned: 0 in 0.394s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:03 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:03 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 Jul 22 02:11:03 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:04 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1" returned: 0 in 0.367s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:04 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1 Jul 22 02:11:04 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:04 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38.b107da46-f877-47d8-a97c-94516a883cd1" returned: 0 in 0.256s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-b107da46-f877-47d8-a97c-94516a883cd1" released by "_delete_snapshot" :: held 1.486s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" released by "delete_snapshot" :: held 1.513s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Created reservations ['7a8392a2-6cfb-4ee0-b115-6756cc91890b', 'f6f27d6c-54ef-4919-bae0-38777eed3336', '332fd0b5-fa06-4bac-ac76-d6cdbef75e83', 'a067debc-c401-4135-a0e5-8da1c16736fd'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:04 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dcbc5718-72d0-437d-8ea4-2428b7fcf013 tempest-ProjectMemberTests-724807965 None] Lock "cinder-b107da46-f877-47d8-a97c-94516a883cd1-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-a96cb540-c3a5-44fd-a504-c806771a4f38-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:04 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "cinder-a96cb540-c3a5-44fd-a504-c806771a4f38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336b975-5046-49f7-9a2c-f7eb1bd93e0e]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:05 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 Jul 22 02:11:05 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:05 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38" returned: 0 in 0.360s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:05 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38 Jul 22 02:11:05 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:05 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-a96cb540-c3a5-44fd-a504-c806771a4f38" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-a96cb540-c3a5-44fd-a504-c806771a4f38" released by "delete_volume" :: held 0.663s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Created reservations ['cd10aa32-a844-418b-85ef-acca04006520', '500b0d66-cf0e-47ca-aa40-50b72c038f7a', 'a85c244d-8398-4343-94f4-a8a3cd90c9c9', 'b7157f9f-736a-4649-bc7c-da380e606924'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:05 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:05 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:11:05 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:06 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.246s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:11:06 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-1221b8e1-ad36-48b3-b510-ef55ac808608 tempest-ProjectMemberTests-724807965 None] Lock "cinder-a96cb540-c3a5-44fd-a504-c806771a4f38-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (8635fb5f-49f6-4a36-a19c-c6c7ae9acd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a82e38-b221-4ae0-a059-cea41e09041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a82e38-b221-4ae0-a059-cea41e09041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437572176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b621e0-a040-44d6-9d5e-3019f835f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:07Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a79e48-fd38-4f5f-b899-9a3cb3b318b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a79e48-fd38-4f5f-b899-9a3cb3b318b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46222f2-add2-4a32-ac73-e6bf6d41fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46222f2-add2-4a32-ac73-e6bf6d41fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b621e0-a040-44d6-9d5e-3019f835f546', 'volume_name': 'volume-e8b621e0-a040-44d6-9d5e-3019f835f546', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7af1a1-15b6-4416-9f42-167aedc5d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7af1a1-15b6-4416-9f42-167aedc5d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0ddb88-6adf-4efa-bcac-4881f07ec092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:06 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Volume e8b621e0-a040-44d6-9d5e-3019f835f546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b621e0-a040-44d6-9d5e-3019f835f546', 'volume_size': 1} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437572176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b621e0-a040-44d6-9d5e-3019f835f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:07Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Creating volume e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:11:06 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:11:06 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:06 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 1073741824 Jul 22 02:11:06 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:07 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 1073741824" returned: 0 in 0.407s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:07 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 Jul 22 02:11:07 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:07 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0ddb88-6adf-4efa-bcac-4881f07ec092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b621e0-a040-44d6-9d5e-3019f835f546', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd56d27-b373-47e1-be6d-a0d03db0544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:07 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Volume volume-e8b621e0-a040-44d6-9d5e-3019f835f546 (e8b621e0-a040-44d6-9d5e-3019f835f546): created successfully Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd56d27-b373-47e1-be6d-a0d03db0544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (8635fb5f-49f6-4a36-a19c-c6c7ae9acd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:11:07 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-f0f7c1c5-b768-4879-ae5c-ee92443a9d0e tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Creating offline snapshot 426e6d21-daab-436b-91a8-584c18d644d7 of volume e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1146cbf-d08f-48f7-bdb7-e923213e1208]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:07 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:07 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 Jul 22 02:11:07 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:08 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:08 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 1G Jul 22 02:11:08 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:08 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 1G" returned: 0 in 0.383s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b621e0-a040-44d6-9d5e-3019f835f546 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:08 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b621e0-a040-44d6-9d5e-3019f835f546 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 Jul 22 02:11:08 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:08 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b621e0-a040-44d6-9d5e-3019f835f546 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7" returned: 0 in 0.284s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:08 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 is being set with open permissions: ugo+rw Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:08 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 Jul 22 02:11:08 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:08 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:08 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7" returned: 0 in 0.235s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:09 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info Jul 22 02:11:09 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:09 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info" returned: 0 in 0.257s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:09 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info is being set with open permissions: ugo+rw Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:09 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info Jul 22 02:11:09 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:09 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.info" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:09 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dc6986d4-33a5-4b61-927e-ae0a44d5a9d7 tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-426e6d21-daab-436b-91a8-584c18d644d7-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-426e6d21-daab-436b-91a8-584c18d644d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-426e6d21-daab-436b-91a8-584c18d644d7" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-426e6d21-daab-436b-91a8-584c18d644d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot 426e6d21-daab-436b-91a8-584c18d644d7 of volume e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6cad73-c868-491d-96e0-5bf06d8d762b]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:09 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:10 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 Jul 22 02:11:10 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:10 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7" returned: 0 in 0.367s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b621e0-a040-44d6-9d5e-3019f835f546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae98ea-5c29-4325-bb9e-05b52c4bc7ba]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:10 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 Jul 22 02:11:10 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:10 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546" returned: 0 in 0.348s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:10 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 Jul 22 02:11:10 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:10 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7" returned: 0 in 0.341s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:10 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:11 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7 Jul 22 02:11:11 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:11 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546.426e6d21-daab-436b-91a8-584c18d644d7" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-426e6d21-daab-436b-91a8-584c18d644d7" released by "_delete_snapshot" :: held 1.391s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" released by "delete_snapshot" :: held 1.410s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Created reservations ['b042d8fb-1fc1-46dd-b33d-8e73a380cfbc', '391c8603-0dcf-42f4-b123-4be06a0258ce', 'e2f7098f-6d7c-4d47-ad63-3175b8998dcf', 'bb9c07da-fc33-4fd8-93cf-61cbb4b44081'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:11 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-b934a830-42e4-4502-be70-492535c7c445 tempest-ProjectMemberTests-724807965 None] Lock "cinder-426e6d21-daab-436b-91a8-584c18d644d7-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:11 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-e8b621e0-a040-44d6-9d5e-3019f835f546-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "cinder-e8b621e0-a040-44d6-9d5e-3019f835f546-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" acquired by "delete_volume" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34ca58-d5ff-4235-ba2b-9e8ec1406d64]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:12 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 Jul 22 02:11:12 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:12 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546" returned: 0 in 0.356s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:12 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546 Jul 22 02:11:12 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:12 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-e8b621e0-a040-44d6-9d5e-3019f835f546" returned: 0 in 0.240s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-e8b621e0-a040-44d6-9d5e-3019f835f546" released by "delete_volume" :: held 0.654s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Created reservations ['8c81ed45-259c-47ea-89dc-634f6a065580', '601e7f8e-fe86-435e-b852-2640cca7bd00', 'ced988cd-f965-41b9-bda5-115ae129ecda', '6f25bb18-fd32-4ed6-9840-2b608fb9fd4d'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:12 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:12 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:11:12 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:13 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.247s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:11:13 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-11c5cb92-ceb0-43eb-9690-97ccf198e13f tempest-ProjectMemberTests-724807965 None] Lock "cinder-e8b621e0-a040-44d6-9d5e-3019f835f546-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87153) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (34dde625-a03d-422f-8d7c-dd882a5466da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa0c96f-e37b-48d3-a761-8f33428b7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa0c96f-e37b-48d3-a761-8f33428b7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046975023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb3d7d-d514-4b95-8de1-35d454273be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:14Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dae05b-0ff4-4d19-99cf-1b2704f07bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dae05b-0ff4-4d19-99cf-1b2704f07bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d7154-0b3b-4b24-acdc-b7ef50c28fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d7154-0b3b-4b24-acdc-b7ef50c28fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33eb3d7d-d514-4b95-8de1-35d454273be8', 'volume_name': 'volume-33eb3d7d-d514-4b95-8de1-35d454273be8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f435ea9-35ac-460a-befa-1c600a29d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f435ea9-35ac-460a-befa-1c600a29d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083bd95-3ce5-4866-9144-eb3c1d3e1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:13 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Volume 33eb3d7d-d514-4b95-8de1-35d454273be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33eb3d7d-d514-4b95-8de1-35d454273be8', 'volume_size': 1} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-22T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2046975023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33eb3d7d-d514-4b95-8de1-35d454273be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51b97d3aed54c6daf9d3151368c6f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-22T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-22T00:11:14Z,use_quota=True,user_id='790a2f59191643ad868995759dab09f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fd0c033-de85-41b5-9aa2-3ab1ab5a0885),volume_type_id=3fd0c033-de85-41b5-9aa2-3ab1ab5a0885)}" {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Creating volume 33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Selected osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e as target Quobyte volume. {{(pid=87153) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 22 02:11:13 devstack cinder-volume[87153]: INFO cinder.volume.drivers.remotefs [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] casted to osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e Jul 22 02:11:13 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 1073741824 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:13 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 1073741824 Jul 22 02:11:13 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:14 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 1073741824" returned: 0 in 0.401s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:14 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 Jul 22 02:11:14 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:14 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8" returned: 0 in 0.253s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'} {{(pid=87153) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7083bd95-3ce5-4866-9144-eb3c1d3e1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33eb3d7d-d514-4b95-8de1-35d454273be8', 'volume_size': 1}' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4642d6-4fe4-4abd-b6f5-4e29160d2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 22 02:11:14 devstack cinder-volume[87153]: INFO cinder.volume.flows.manager.create_volume [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Volume volume-33eb3d7d-d514-4b95-8de1-35d454273be8 (33eb3d7d-d514-4b95-8de1-35d454273be8): created successfully Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4642d6-4fe4-4abd-b6f5-4e29160d2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87153) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Flow 'volume_create_manager' (34dde625-a03d-422f-8d7c-dd882a5466da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87153) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 22 02:11:14 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-9a13edf5-41cf-4f55-9e02-167e40617aec tempest-ProjectMemberTests-724807965 None] Created volume successfully. Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Creating offline snapshot d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 of volume 33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[0596e936-4217-44bf-ac9c-738f8783b071]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:14 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:14 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 Jul 22 02:11:14 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:15 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8" returned: 0 in 0.350s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 1G {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:15 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 1G Jul 22 02:11:15 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:15 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 1G" returned: 0 in 0.373s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb3d7d-d514-4b95-8de1-35d454273be8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:15 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb3d7d-d514-4b95-8de1-35d454273be8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 Jul 22 02:11:15 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:15 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33eb3d7d-d514-4b95-8de1-35d454273be8 -F qcow2 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" returned: 0 in 0.281s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:15 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 is being set with open permissions: ugo+rw Jul 22 02:11:15 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:15 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 Jul 22 02:11:15 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:15 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" returned: 0 in 0.235s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:16 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info Jul 22 02:11:16 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:16 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info" returned: 0 in 0.249s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:16 devstack cinder-volume[87153]: WARNING cinder.volume.drivers.remotefs [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info is being set with open permissions: ugo+rw Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:16 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info Jul 22 02:11:16 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:16 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.info" returned: 0 in 0.241s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:16 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-09a43de2-edbb-4fa5-8e8a-ce43b6220f6f tempest-ProjectMemberTests-724807965 None] Create snapshot completed successfully Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8-delete_snapshot" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" by "delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" by "_delete_snapshot" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:16 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Deleting offline snapshot d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 of volume 33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] snapshot_file for this snap is: volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[349837e1-04fe-4a53-9451-daa5855a6b2d]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:17 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 Jul 22 02:11:17 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:17 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" returned: 0 in 0.354s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.remotefs [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33eb3d7d-d514-4b95-8de1-35d454273be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87153) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d556b70-ba95-4e76-a02e-71b0d1bbe8bc]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:17 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 Jul 22 02:11:17 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:17 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8" returned: 0 in 0.347s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:17 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:17 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 Jul 22 02:11:17 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:18 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" returned: 0 in 0.311s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:18 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8 Jul 22 02:11:18 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:18 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8.d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" returned: 0 in 0.242s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8" released by "_delete_snapshot" :: held 1.341s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" released by "delete_snapshot" :: held 1.363s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Created reservations ['312d7a39-3f0a-42d6-bd25-47ab2aa1683e', '56fcd6d8-d6c5-431c-a7c3-819eee5edf18', 'e3bbf8dd-e196-494e-9bb5-23987c6617fc', '1d546541-fe25-4f28-8754-f82b202de9a0'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:18 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Delete snapshot completed successfully. Jul 22 02:11:18 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-dba3335a-fc55-4fef-b5fe-707f05339638 tempest-ProjectMemberTests-724807965 None] Lock "cinder-d761c87c-7bc6-4bd1-a965-fcfa7ff413d8-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-33eb3d7d-d514-4b95-8de1-35d454273be8-delete_volume" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "cinder-33eb3d7d-d514-4b95-8de1-35d454273be8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Acquiring lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" by "delete_volume" {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" acquired by "delete_volume" :: waited 0.016s {{(pid=87153) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af0369a-4f88-4b3f-96f7-60a65d6b26c4]: (4, 'qcow2') {{(pid=89077) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:19 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 Jul 22 02:11:19 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:19 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8" returned: 0 in 0.357s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:19 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8 Jul 22 02:11:19 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:19 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2/volume-33eb3d7d-d514-4b95-8de1-35d454273be8" returned: 0 in 0.243s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "cinder-quobyte-33eb3d7d-d514-4b95-8de1-35d454273be8" released by "delete_volume" :: held 0.656s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.quota [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Created reservations ['cdf44141-00ca-4a10-937f-63ec8448cf59', 'ed1a58f7-be98-437c-92d4-da1159dcf86b', '77441615-7600-467b-b694-3c83fb35a6d0', 'f8993ca6-8827-4d47-9ee1-1a30f9d88926'] {{(pid=87153) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e': None} {{(pid=87153) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG cinder.volume.drivers.quobyte [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d7ef71e7-4a01-4842-9bbd-b0e759f5621e'] {{(pid=87153) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.lockutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87153) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 22 02:11:19 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 22 02:11:19 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2 Jul 22 02:11:19 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 22 02:11:20 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 22 02:11:20 devstack cinder-volume[87153]: DEBUG oslo_concurrency.processutils [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523df77620a5e09dff816cbfbab36cf2" returned: 0 in 0.240s {{(pid=87153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 22 02:11:20 devstack cinder-volume[87153]: DEBUG cinder.manager [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Notifying Schedulers of capabilities ... {{(pid=87153) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 22 02:11:20 devstack cinder-volume[87153]: INFO cinder.volume.manager [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Deleted volume successfully. Jul 22 02:11:20 devstack cinder-volume[87153]: DEBUG cinder.coordination [None req-285a3440-7e41-4743-b986-2ae7aacbab16 tempest-ProjectMemberTests-724807965 None] Lock "cinder-33eb3d7d-d514-4b95-8de1-35d454273be8-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87153) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 22 02:11:29 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:SELECT=83,cinder:UPDATE=120,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 22 02:11:30 devstack cinder-volume[87153]: DEBUG dbcounter [-] [87153] Writing DB stats cinder:INSERT=34,cinder:UPDATE=117,cinder:SELECT=97,cinder:DELETE=8 {{(pid=87153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}